-- Logs begin at Thu 2022-06-16 16:55:59 UTC, end at Thu 2022-06-16 18:05:30 UTC. -- Jun 16 17:34:55.715428 dv-cinder-837542-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:34:55.723189 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:34:55 2022] *** Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: nodename: dv-cinder-837542-4-iscsi Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: machine: x86_64 Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: clock source: unix Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: pcre jit disabled Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: detected number of CPU cores: 4 Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: current working directory: / Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:34:55.726300 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: your processes number limit is 47680 Jun 16 17:34:55.726963 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: your memory page size is 4096 bytes Jun 16 17:34:55.726963 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: detected max file descriptor number: 2048 Jun 16 17:34:55.726963 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: lock engine: pthread robust mutexes Jun 16 17:34:55.726963 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: thunder lock: enabled Jun 16 17:34:55.726963 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:34:55.726963 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:34:55.771788 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: Python main interpreter initialized at 0x55ae2ccc29c0 Jun 16 17:34:55.771788 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: python threads support enabled Jun 16 17:34:55.771788 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: your server socket listen backlog is limited to 100 connections Jun 16 17:34:55.771788 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:34:55.772176 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:34:55.772253 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: *** Operational MODE: preforking *** Jun 16 17:34:55.772493 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:34:55.772493 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: spawned uWSGI master process (pid: 109770) Jun 16 17:34:55.772692 dv-cinder-837542-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:34:55.776527 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: spawned uWSGI worker 1 (pid: 109771, cores: 1) Jun 16 17:34:55.776527 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: spawned uWSGI worker 2 (pid: 109772, cores: 1) Jun 16 17:34:55.776527 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:34:56.430759 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:34:56.437623 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:34:57.606121 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:34:57.606121 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: from cryptography.utils import int_from_bytes Jun 16 17:34:57.607367 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:34:57.607367 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: from cryptography.utils import int_from_bytes Jun 16 17:34:57.612471 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:34:57.612471 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: from cryptography.utils import int_from_bytes Jun 16 17:34:57.612906 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:34:57.612906 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: from cryptography.utils import int_from_bytes Jun 16 17:35:00.202330 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:35:00.202932 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:35:00.203366 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:35:00.203731 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:35:00.203989 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:35:00.204403 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.204719 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.205045 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.205356 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.205682 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.205988 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.206301 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.206614 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.206932 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.207189 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.207495 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.207808 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-4-iscsi {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.208121 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.208450 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.208754 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.209066 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.209364 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.209680 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.209983 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.210463 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.210890 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.211176 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.211492 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.211840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.212128 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.212453 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.212767 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.213069 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.213384 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.213684 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.214073 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-4-iscsi {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.214385 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.214686 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.214992 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.215395 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.215697 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.216043 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.216458 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.216780 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.217084 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.217404 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.217715 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.218026 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.218338 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.218635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.218935 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.219237 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.219547 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.219845 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.220142 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.220401 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.220702 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.221016 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.221330 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.221643 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.221890 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.222132 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.222442 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.222751 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.223051 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.223349 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.223647 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.223945 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.224241 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.224574 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.224870 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.225168 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.225478 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.225784 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.226097 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.226394 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.226702 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.227088 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.227329 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.227629 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.228008 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.228317 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.228644 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.228954 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.229264 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.229560 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.229857 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.230155 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.230467 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.230789 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.231085 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.231334 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.232171 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.232614 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.233054 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.233573 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.233890 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.234197 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.234495 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.234799 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.235099 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.235400 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.235698 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.235998 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.236294 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.236619 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.236919 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.237217 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.237527 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.237839 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.238138 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.238434 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.238733 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.239031 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.239341 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.239638 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.239934 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.240246 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.240575 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.240876 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.241192 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.241491 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.241788 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.242096 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.242390 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.242684 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.242991 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.243290 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.243586 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.243880 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.244174 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.244490 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.244788 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.245081 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.245376 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.245665 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.245972 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.246284 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.246585 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.246878 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.247172 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.248271 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.248804 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.249146 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.249490 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.249805 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.250136 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.250468 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.250784 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.251093 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.251405 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.251725 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.252032 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.252346 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.252676 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.252990 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.253303 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.253627 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.253936 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.254246 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.254559 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.254865 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.255173 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.255495 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.255810 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.256114 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.256467 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.256809 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.257115 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.257431 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.257747 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.258052 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.258356 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.258659 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.258972 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.259303 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.259608 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.259919 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.260223 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.260549 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.260855 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.261164 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.261464 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.261790 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.262098 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.262400 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.262703 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.263397 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.263717 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.264252 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.264333 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.264653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.264959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.265256 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.265563 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.265865 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.266180 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.266501 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.266801 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.267128 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.267427 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.267736 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.268044 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.268350 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.268673 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.268980 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.269283 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.269581 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.269908 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.270211 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.270511 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.270828 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.271133 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.271684 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.271990 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.272295 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.272623 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.272929 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.273237 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.273551 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.273861 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.274168 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.274496 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.274824 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.275123 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.275441 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.275757 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.276066 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.276363 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.276686 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.276985 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.277282 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.277579 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.277880 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.278177 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.278532 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.279882 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.279882 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.279882 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.279882 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.280211 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.280339 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.280746 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.281051 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.281388 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.281687 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.282021 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.282352 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.282665 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.282980 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.283287 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.283597 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.283902 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.284207 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.284535 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.284843 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.285155 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.285461 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.285773 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.286078 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.286394 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.286698 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.287011 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.287308 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.287618 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.287949 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.288277 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.288609 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.288927 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.289232 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.289539 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.289843 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.290145 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.290448 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.290753 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.291089 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.291386 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.291694 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.292000 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.292317 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.292640 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.292947 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.293246 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.293552 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.293872 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.294816 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.295361 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.295910 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.296229 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.296562 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.296875 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.297185 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.297489 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.297794 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.298102 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.298412 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.298717 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.299022 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.299323 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.299631 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.299935 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.300236 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.300580 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.300893 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.301217 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.301530 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.301848 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.302164 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.302464 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.302765 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.303083 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.303390 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.303690 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.303989 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.304286 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.304865 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.305173 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.305475 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.305846 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.306198 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.306501 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.306811 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.307117 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.307421 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.307772 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.308095 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.308431 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.308719 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.309055 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.312476 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.312858 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.313197 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.313519 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.313835 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.314162 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.314476 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.314787 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.315104 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.315678 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.316008 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.316327 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.316673 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.316986 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.317300 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.317629 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.317953 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.318290 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.318599 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.318907 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.319207 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.319508 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.319816 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.320116 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.320425 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.320737 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.321041 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.321341 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.321638 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.321945 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.322230 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.322537 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.322829 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.323129 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.323427 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.323742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.324237 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.324419 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.324653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.324950 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.325281 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.325887 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.326139 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.326467 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.326806 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.327105 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.327403 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.327720 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.328020 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.328315 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.328790 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.329040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.329343 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.329643 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.329942 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.330247 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.330545 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.330852 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.331147 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.331446 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.332157 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.332157 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.332455 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.332638 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.332937 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.333240 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.333540 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.333834 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.334140 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.334435 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.334744 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.335040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.335336 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.335630 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.336002 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.336228 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.336618 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.336934 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.337235 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.337530 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.337825 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.338123 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.338418 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.338730 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.339263 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.339727 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.340044 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.340343 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.340671 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.341011 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.341314 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.341610 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.341911 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.343635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.343635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.343635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.343635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.343635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.343635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.344076 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.344223 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.344544 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.344831 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.345171 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.345462 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.345811 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.346111 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.346415 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.346725 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.347028 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.347332 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.347638 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.347934 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.348240 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.348564 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.348870 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.349165 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.349462 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.349774 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.350078 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.350380 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.350692 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.351005 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.351319 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.351613 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.351913 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.352214 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.352534 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.352836 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.353136 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.353436 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.353741 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.354049 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.354352 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.354655 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.354954 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.355255 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.355557 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.355854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.356239 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.356496 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.357419 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.357740 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.358039 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.358346 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.358644 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.359074 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.359379 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.359683 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.359980 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.360283 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.360610 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.360922 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.361230 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.361529 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.361934 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.362238 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.362540 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.362845 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.363144 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.363441 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.363744 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.364060 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.364357 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.364676 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.364975 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.365290 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.365586 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.365898 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.366306 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.366609 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.366905 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.367313 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.367617 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.367919 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.368234 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.368617 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.368969 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.369270 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.369576 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.369879 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.370197 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.370515 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.370819 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.371125 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.371423 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.371739 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.372054 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.372974 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.373295 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.373787 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.374106 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.374415 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.374733 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.375052 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.375351 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.375649 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.375952 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.376251 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.376576 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.376891 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.377190 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.377491 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.377794 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.378095 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.378390 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.378685 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.378998 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.379294 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.379607 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.379912 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.380226 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.380562 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.380865 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.381180 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.381483 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.381783 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.382082 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.382380 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.382716 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.383018 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.383332 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.383656 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.383977 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.384285 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.384638 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.384961 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.385273 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.385584 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.385903 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.386202 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.386506 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.386800 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.387097 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.387396 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.387691 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.388104 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.388650 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.388958 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.389258 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.389581 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.389967 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.390282 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.390587 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.390888 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.391189 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.391488 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.391826 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.392126 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.392476 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.392794 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.393109 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.393428 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.393730 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.394046 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.394356 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.394669 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.394976 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.395283 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.395591 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.395896 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.396204 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.396800 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.397107 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.397413 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.397722 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.398275 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.398599 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.398909 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.399216 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.399523 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.399830 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.400136 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.400465 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.400773 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.401077 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.401381 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.401705 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.402024 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.402343 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.402671 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.402981 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.403290 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.403741 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.404120 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.404519 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.404833 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.405137 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.405448 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.405758 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.406067 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.406372 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.406678 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.406986 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.407290 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.407596 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.407899 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.408206 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.408538 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.408856 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.409182 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.409497 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.409803 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.410110 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.410416 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.410923 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.411230 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.411552 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.411870 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.412188 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.412524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.412838 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.413156 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.413456 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.413754 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.414057 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.414361 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.414657 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.414971 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.415275 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.415571 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.415883 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.416185 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.416739 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.417080 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.417393 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.417710 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.418026 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.418335 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.418634 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.418949 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.419860 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.420235 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.420568 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.420877 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.421176 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.421474 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.421793 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.422083 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.422381 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.422684 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.422982 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.423301 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.423600 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.423898 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.424196 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.424520 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.424825 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.425121 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.425420 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.425716 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.426021 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.426319 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.426620 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.426916 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.427220 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.427516 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.427818 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.428168 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.428504 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.428805 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.429103 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.429408 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.429712 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.430026 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.430331 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.430634 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.430970 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.431278 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.431804 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.432136 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.432478 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.432810 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.433136 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.433441 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.433742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.434044 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.434364 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.434683 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.435550 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.435929 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.436235 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.436563 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.436869 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.437178 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.437481 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.437783 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.438085 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.438387 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.438690 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.438992 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.439299 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.439635 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.439947 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.440256 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.440587 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.440898 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.441201 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.441503 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.441806 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.442108 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.442417 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.442740 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.443049 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.443346 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.443760 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.444064 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.444392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.444703 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.445011 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.445325 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.445639 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.445943 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.446259 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.446563 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.446883 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.447214 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.447535 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.447851 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.448150 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.448468 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.448768 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.449069 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.449379 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.449694 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.449977 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.450272 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.450831 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.451136 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.451433 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.451730 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.452029 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.452398 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.452649 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.452948 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.453245 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.453540 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.453836 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.454134 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.454435 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.454731 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.455033 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.455327 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.455621 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.455917 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.456241 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.456589 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.456900 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.457216 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.457521 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.457834 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.458137 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.458450 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.458765 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.459072 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.459373 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.459697 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.459999 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.460300 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.460628 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.460931 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.461234 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.461537 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.461859 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.462178 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.462480 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.462797 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.463107 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.463419 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.463727 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.464032 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.464352 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.464679 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.464989 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.465299 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.465603 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.465908 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.466441 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.466849 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.467173 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.467495 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.467802 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.468121 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.468465 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.468810 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.469116 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.469451 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.469776 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.470086 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.470392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.470693 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.470930 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:35:00.535755 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO dbcounter [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Registered counter for database nova_api Jun 16 17:35:00.556912 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:00.564063 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writer thread running {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:00.622057 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.context [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3bf93b-fd76-402a-824a-0db7ba7f07c6(cell1) {{(pid=109771) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:35:00.626345 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.627912 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.628712 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.630652 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.632665 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO dbcounter [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Registered counter for database nova_cell0 Jun 16 17:35:00.636408 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO dbcounter [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Registered counter for database nova_cell1 Jun 16 17:35:00.644739 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:00.646725 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:00.652416 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writer thread running {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:00.655299 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writer thread running {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:00.682017 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:35:00.682519 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:35:00.683244 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:35:00.683812 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:35:00.684219 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:35:00.684884 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.685463 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.685910 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.686417 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.686945 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.687438 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.687949 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.688497 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.689023 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.689471 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.689977 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.690496 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-4-iscsi {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.691009 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.691500 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.691949 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.692412 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.692844 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.693293 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.693720 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.694461 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.694902 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.695334 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.695774 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.696248 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.696722 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.697157 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.697602 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.698032 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.698479 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.698912 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.699457 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-4-iscsi {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.699899 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.700359 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.700824 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.701402 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.701841 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.702275 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.702769 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.703171 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.703601 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.704061 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.704537 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.704986 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.705434 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.705857 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.706286 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.706717 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.707167 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.707601 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.708034 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.708394 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.708850 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.709304 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.709751 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.710199 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.710549 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.710897 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.711339 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.711787 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.712219 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.712679 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.713112 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.713542 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.713989 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.714405 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.714831 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.715259 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.715705 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.716692 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.717162 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.717624 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.718097 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.718686 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.719057 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.719528 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.720044 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.720740 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.721030 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.721492 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.721956 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.722401 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.722844 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.723295 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.723790 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.724307 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.724819 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.725207 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.725696 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.726197 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.726685 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.727158 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.727605 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.728060 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.728559 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.729046 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.729523 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.730013 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.730515 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.730984 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.731427 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.732472 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.732928 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.733366 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.733828 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.734292 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.734738 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.735181 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.735627 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.736086 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.736577 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.737021 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.737468 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.737936 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.738388 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.738825 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.739272 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.739708 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.740147 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.740632 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.741068 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.741506 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.741961 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.742402 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.742837 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.743267 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.743697 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.744125 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.744584 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.745019 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.745448 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.745873 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.746320 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.746773 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.747236 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.747677 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.748187 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.748589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:35:00.749071 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.749539 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.750030 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.750479 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.750950 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.751424 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.751890 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.752321 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.752807 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.753277 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.753726 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.754174 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.754632 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.755095 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.755575 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.756068 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.756570 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.757044 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.757525 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.757993 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.758483 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.758961 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.759428 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.759877 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.760384 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.760916 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.761399 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.761894 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.762410 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.762988 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.763526 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.764032 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.764555 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.765079 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.765567 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.766054 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.766605 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.767140 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.767701 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.768168 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.768687 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.769167 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.769659 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.770143 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.770637 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.771134 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.771871 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.772408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.772952 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.773494 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.774028 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.774565 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.775091 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.775591 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.775971 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.776469 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.776940 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.777283 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.777596 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.777912 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.778227 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.779071 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.779441 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.779758 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.780073 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.780405 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.780734 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.781048 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.781355 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.781722 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.781978 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.782281 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.782595 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.782905 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.783213 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.783523 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.783831 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.784151 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.784490 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.784806 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.785138 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.785474 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.785768 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.786089 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.786410 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.786724 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.787026 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.787332 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.787632 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.788144 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.788237 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.788547 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.788847 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.789149 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.789449 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.789749 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.790047 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.790363 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.790666 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.790965 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.791265 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.791563 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.791902 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.793027 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.793027 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.793027 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.793241 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.793491 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.793866 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.794709 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.795017 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.795327 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.795638 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.796009 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.796257 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.796589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.796905 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.797215 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.797536 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.797843 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.798159 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.798460 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.798975 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.799095 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.799425 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.799833 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.800089 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.800358 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.800691 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.800999 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.801303 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.801609 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.802011 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.802358 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO dbcounter [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Registered counter for database nova_cell0 Jun 16 17:35:00.802455 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.802871 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.803314 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.803749 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.815981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816534 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.816617 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817175 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817637 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writer thread running {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.817715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818176 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818713 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818713 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.818927 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821287 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821817 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.821817 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.822288 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.822620 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.823088 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.823560 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.824107 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.824647 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.825026 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.825562 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.826091 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.826559 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.827013 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.827459 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.827911 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.828447 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.828930 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.829423 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.829903 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.830387 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.830867 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.831303 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.831794 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.832278 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.832838 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.833339 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.833846 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.834448 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.834824 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.835261 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.835696 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.836139 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.836637 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.837152 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.837584 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.838077 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.838568 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.839066 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.839519 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.839985 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.840516 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.841515 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.841987 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.842467 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.842974 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.843469 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.843942 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.844448 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.844944 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.845394 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.845902 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.846449 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.846998 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.847516 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.848032 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.848560 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.849059 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.849499 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.849850 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.850404 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.850952 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.851509 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.852062 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.852664 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.853189 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.853671 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.854093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.854547 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.855017 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.855462 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.855927 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.856391 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.856906 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.857345 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.857780 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.858210 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.858636 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.859069 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.859519 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.859964 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.860410 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.860850 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.861280 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.861708 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.862133 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.862566 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.862988 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.863564 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.864003 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.864464 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.864897 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.865359 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.865796 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.866225 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.866655 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.867087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.867575 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.868008 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.868545 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.868986 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.869430 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.869879 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.870320 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.870757 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.871198 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.871625 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.872067 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.873070 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.873510 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.873936 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.874365 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.874817 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.875266 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.875707 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.876162 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.876651 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.877151 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.877484 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.877796 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.878108 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.878419 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.878727 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.879036 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.879346 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.879656 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.880033 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.880278 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.880612 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.880920 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.881227 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.881536 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.881976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.882237 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.882474 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.882875 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.883160 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.883424 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.883734 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.884037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.884497 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.884810 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.885595 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.885595 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.885844 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.886049 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.886362 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.886675 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.886974 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.887387 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.887694 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.888727 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.889105 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.889424 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.889731 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.890036 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.890359 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.890663 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.890970 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.891269 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.891608 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.891891 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.892206 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.892647 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.892999 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.893424 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.894004 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.894448 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.894920 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.895408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.895887 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.896636 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.897104 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.897537 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.897851 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.898248 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.898653 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.898970 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.899284 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.899588 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.900101 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.900631 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.901141 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.901641 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.902294 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.902786 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.903186 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.903727 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.904260 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.904790 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.905301 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.905806 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.906275 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.906754 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.907219 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.907660 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.908110 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.908597 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.909046 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.909502 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.909948 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.910416 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.910867 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.911345 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.911804 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.912282 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.912770 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.913240 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.913708 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.914149 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.914601 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.915060 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.915521 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.916060 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.916562 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.917111 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.917578 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.918109 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.918606 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.919673 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.921200 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.921200 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.921200 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.922069 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.922138 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.922602 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.923475 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.923629 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.923936 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.924386 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.924839 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.926158 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.926158 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.926158 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.926569 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.927000 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.927466 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.927907 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.928345 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.928809 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.929245 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.929732 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.930164 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.930634 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.931088 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.931542 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.932007 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.932471 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.932930 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.933378 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.933824 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.934267 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.934770 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.935733 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.936190 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.936673 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.937132 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.937588 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.938039 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.938490 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.939273 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.939745 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.940200 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.940672 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.941119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.941563 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.942006 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.942444 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.942883 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.943323 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.943763 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.944233 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.944723 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.945193 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.945681 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.946138 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.946586 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.947033 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.947484 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.947980 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.948453 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.948894 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.949338 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.949784 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.950228 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.950714 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.951151 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.951598 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.952041 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.952507 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.953002 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.953405 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.953852 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.954311 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.954787 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.955242 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.955700 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.956142 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.956625 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.957391 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.957822 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.958290 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.958753 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.959212 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.959666 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.960119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.960625 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.961071 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.961534 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.962006 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.962471 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.962929 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.963407 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.963878 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.964339 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.964869 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.965327 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.966536 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.966647 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.967143 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.967658 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.968174 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.968701 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.969185 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.969715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.970222 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.970710 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.971170 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.971635 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.972069 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.972530 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.972976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.973414 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.973844 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.974282 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.974708 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.975166 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.975602 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.976039 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.976481 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.976922 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.977353 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.977811 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.978206 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.978634 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.979080 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.979513 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.979952 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.980394 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.980858 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.981290 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.982250 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.982734 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.983192 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.983626 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.984058 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.984539 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.984981 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.985440 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.985881 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.986319 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.986802 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.987249 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.988011 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.988512 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.988973 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.989444 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.989912 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.990349 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.990785 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.991220 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.991683 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.992129 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.992599 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.993045 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.993483 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.993917 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.994354 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.994791 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.995226 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.995666 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.996101 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.996564 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.997002 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.998123 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.998535 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.998907 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.999357 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:00.999805 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.000248 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.000723 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.001164 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.001601 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.002041 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.002479 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.002928 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.003395 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.003839 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.004273 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.005054 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.005510 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.005967 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.006421 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.006864 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.007317 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.007773 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.008213 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.008696 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.009137 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.009598 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.010071 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.010534 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.010990 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.011420 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.011849 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.012276 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.012744 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.013435 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.013660 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.014095 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.014526 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.014966 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.015406 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.015839 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.016264 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.016723 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.017155 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.017578 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.018003 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.018428 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.018850 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.019271 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.019696 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.020128 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.020577 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.021005 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.021694 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.022119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.022541 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.023002 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.023468 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.023913 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.024362 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.024826 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.025279 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.025725 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.026182 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.026639 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.027085 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.027524 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.027992 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.028482 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.028923 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.029363 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.029794 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.030230 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.030666 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.031120 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.031572 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.032005 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.032485 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.032935 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.033382 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.033825 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.034261 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.034722 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.035157 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.035599 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.036040 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.036500 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.036944 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.037393 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.037850 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.038314 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.038827 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.039218 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.039695 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.040184 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.040724 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.041192 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.041704 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.042199 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.042685 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.043159 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.043605 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:35:01.043955 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:35:01.139639 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO dbcounter [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Registered counter for database nova_api Jun 16 17:35:01.152134 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: WARNING keystonemiddleware.auth_token [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:35:01.159519 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: WARNING keystonemiddleware.auth_token [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:35:01.166786 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:01.174201 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writer thread running {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:01.233527 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.context [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3bf93b-fd76-402a-824a-0db7ba7f07c6(cell1) {{(pid=109772) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:35:01.237656 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_concurrency.lockutils [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:01.239351 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_concurrency.lockutils [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.240222 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_concurrency.lockutils [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:01.242345 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_concurrency.lockutils [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.244452 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO dbcounter [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Registered counter for database nova_cell0 Jun 16 17:35:01.249345 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO dbcounter [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Registered counter for database nova_cell1 Jun 16 17:35:01.258727 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:01.262468 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:01.265297 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writer thread running {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:01.441278 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writer thread running {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:01.452501 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO dbcounter [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Registered counter for database nova_cell0 Jun 16 17:35:01.461521 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG oslo_db.sqlalchemy.engines [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:35:01.466131 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writer thread running {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:35:01.504687 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: WARNING keystonemiddleware.auth_token [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:35:01.510740 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: WARNING keystonemiddleware.auth_token [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:35:01.516487 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae2ccc29c0 pid: 109771 (default app) Jun 16 17:35:01.518532 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:01.519714 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jun 16 17:35:01.520118 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Jun 16 17:35:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:01.808516 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: WARNING keystonemiddleware.auth_token [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:35:01.816408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: WARNING keystonemiddleware.auth_token [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:35:02.174478 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: WARNING keystonemiddleware.auth_token [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:35:02.180597 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: WARNING keystonemiddleware.auth_token [None req-e0c1e576-107c-4891-aef0-a8befaac9c26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:35:02.185984 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ae2ccc29c0 pid: 109772 (default app) Jun 16 17:36:19.126533 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:19.128206 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Jun 16 17:36:19.128872 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:19.144809 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writing DB stats nova_api:SELECT=3 {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:19.146428 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writing DB stats nova_cell0:SELECT=3 {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:19.147463 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writing DB stats nova_cell1:SELECT=3 {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:19.148500 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writing DB stats nova_cell0:SELECT=3 {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:19.578112 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-a8a3c062-04b7-4d4a-acc0-1149a2980371 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:19.611061 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-a8a3c062-04b7-4d4a-acc0-1149a2980371 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474681 Jun 16 17:36:19.614035 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jun 16 17:36:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:21.821813 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:21.822935 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-f9b80e73-4b1d-41e2-9f77-6d7048125499 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jun 16 17:36:21.823564 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:21.897037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-58601a9e-675f-457c-acc4-76cc927a5e38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "disk": 1, "vcpus": 1}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:21.917619 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:36:21.917619 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: warnings.warn(msg) Jun 16 17:36:21.944787 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-58601a9e-675f-457c-acc4-76cc927a5e38 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115036 Jun 16 17:36:21.945431 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:36:21.959385 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_api:SELECT=3 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:21.960654 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_cell1:SELECT=3 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:21.961496 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_cell0:SELECT=3 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:21.962906 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:22.176229 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-591c9076-b6a2-4eb1-a2c8-7906ed63cf8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:22.178703 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:36:22.178703 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: warnings.warn(msg) Jun 16 17:36:22.241493 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-591c9076-b6a2-4eb1-a2c8-7906ed63cf8c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287382 Jun 16 17:36:22.242253 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jun 16 17:36:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:24.489772 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-58601a9e-675f-457c-acc4-76cc927a5e38 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:24.490786 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-58601a9e-675f-457c-acc4-76cc927a5e38 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 17:36:24.491182 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:24.618979 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-6e0bd746-c78f-4b76-b122-1bb42e198226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:24.648704 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:36:24.648704 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: warnings.warn(msg) Jun 16 17:36:24.671406 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-6e0bd746-c78f-4b76-b122-1bb42e198226 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.173516 Jun 16 17:36:24.671896 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:36:24.685089 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-d8f64513-3e84-4683-b17f-f336d946ec7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:24.686567 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:36:24.686567 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: warnings.warn(msg) Jun 16 17:36:24.719546 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-d8f64513-3e84-4683-b17f-f336d946ec7e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039068 Jun 16 17:36:24.720132 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jun 16 17:36:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:26.925344 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-6e0bd746-c78f-4b76-b122-1bb42e198226 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:26.926958 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-6e0bd746-c78f-4b76-b122-1bb42e198226 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Jun 16 17:36:26.927527 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:26.992303 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-982cc5c4-fa37-42bf-87cf-aaf40ae2a2da admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:27.012237 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-982cc5c4-fa37-42bf-87cf-aaf40ae2a2da admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077927 Jun 16 17:36:27.012958 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:36:27.025512 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-6860dbb2-a5b3-4bf6-a65c-5f2a0596f8e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:27.050377 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-6860dbb2-a5b3-4bf6-a65c-5f2a0596f8e6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028918 Jun 16 17:36:27.056408 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jun 16 17:36:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:29.290760 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-982cc5c4-fa37-42bf-87cf-aaf40ae2a2da admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:29.293399 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-982cc5c4-fa37-42bf-87cf-aaf40ae2a2da admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004306 Jun 16 17:36:29.293895 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:29.356512 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-ec463c99-3d0b-48ea-a1ec-ecbbd74489c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:29.382048 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-ec463c99-3d0b-48ea-a1ec-ecbbd74489c7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082005 Jun 16 17:36:29.382603 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:36:29.396124 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-1e0a62c1-5e2c-4507-bcfd-8bf8a18fb840 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:29.422286 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-1e0a62c1-5e2c-4507-bcfd-8bf8a18fb840 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030427 Jun 16 17:36:29.422901 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jun 16 17:36:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:31.686810 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-ec463c99-3d0b-48ea-a1ec-ecbbd74489c7 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:31.687810 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-ec463c99-3d0b-48ea-a1ec-ecbbd74489c7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 16 17:36:31.688208 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:31.750870 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-084dc7c4-7e4c-48cc-966a-4d35290f5b89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "disk": 20}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:31.771156 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-084dc7c4-7e4c-48cc-966a-4d35290f5b89 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077069 Jun 16 17:36:31.772625 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:36:31.784150 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-254fad3a-c79f-4715-9955-74ad6280c315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:31.809685 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-254fad3a-c79f-4715-9955-74ad6280c315 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029375 Jun 16 17:36:31.825451 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jun 16 17:36:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:34.012666 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-084dc7c4-7e4c-48cc-966a-4d35290f5b89 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:34.013673 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-084dc7c4-7e4c-48cc-966a-4d35290f5b89 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 16 17:36:34.015360 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:34.078396 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-ecce3d35-f2f3-4564-9442-2c4eebfd5840 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:34.103436 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-ecce3d35-f2f3-4564-9442-2c4eebfd5840 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082991 Jun 16 17:36:34.104102 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jun 16 17:36:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:36.369908 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-084dc7c4-7e4c-48cc-966a-4d35290f5b89 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:36.371041 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-084dc7c4-7e4c-48cc-966a-4d35290f5b89 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 16 17:36:36.371456 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:36:36.431581 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-64e5ac34-9031-464a-8fed-c0be80414cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:36.452116 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-64e5ac34-9031-464a-8fed-c0be80414cb6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074251 Jun 16 17:36:36.456411 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:36:36.465539 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-6532c6c0-b5e3-4613-bff0-218afbc3789b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:36.487798 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-6532c6c0-b5e3-4613-bff0-218afbc3789b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026728 Jun 16 17:36:36.488357 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jun 16 17:36:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:38.641544 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-64e5ac34-9031-464a-8fed-c0be80414cb6 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:38.642879 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-64e5ac34-9031-464a-8fed-c0be80414cb6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jun 16 17:36:38.643360 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:38.704318 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-322d7082-afbd-4039-912d-4770e8f5367d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:38.722102 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-322d7082-afbd-4039-912d-4770e8f5367d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071937 Jun 16 17:36:38.722740 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:36:38.736604 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-49394fbb-6127-4850-a181-5c37d030eba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:38.763202 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-49394fbb-6127-4850-a181-5c37d030eba8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031495 Jun 16 17:36:38.763780 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jun 16 17:36:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:40.982416 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-322d7082-afbd-4039-912d-4770e8f5367d admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:40.983393 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-322d7082-afbd-4039-912d-4770e8f5367d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 16 17:36:40.983801 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:41.045150 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-70831034-3681-4645-b3f6-a36fa1e0a6f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "id": "3", "name": "m1.medium"}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:41.064059 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-70831034-3681-4645-b3f6-a36fa1e0a6f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074487 Jun 16 17:36:41.065095 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:36:41.078422 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-ddf62055-93f2-4d8c-914a-ad1b66b14715 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:41.107900 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-ddf62055-93f2-4d8c-914a-ad1b66b14715 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034211 Jun 16 17:36:41.108841 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jun 16 17:36:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:43.312547 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-70831034-3681-4645-b3f6-a36fa1e0a6f0 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:43.313559 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-70831034-3681-4645-b3f6-a36fa1e0a6f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 16 17:36:43.313958 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:43.372463 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-d99cc482-38bb-4a77-9330-0e59115a958c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:43.390266 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-d99cc482-38bb-4a77-9330-0e59115a958c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069998 Jun 16 17:36:43.390812 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:36:43.402805 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-a6057dc3-1a3b-49b9-b595-9a056b3634c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:43.425200 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-a6057dc3-1a3b-49b9-b595-9a056b3634c8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025974 Jun 16 17:36:43.425767 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jun 16 17:36:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:45.693653 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-d99cc482-38bb-4a77-9330-0e59115a958c admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:45.694848 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-d99cc482-38bb-4a77-9330-0e59115a958c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 16 17:36:45.695265 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:36:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:45.769317 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-362bd276-eac8-46b8-a078-c1477d17015f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:45.793534 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-362bd276-eac8-46b8-a078-c1477d17015f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.092272 Jun 16 17:36:45.794371 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jun 16 17:36:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:36:45.806695 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-28a5860a-4c45-4568-9760-75b05d76b5a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:45.832360 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-28a5860a-4c45-4568-9760-75b05d76b5a4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029987 Jun 16 17:36:45.832956 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jun 16 17:36:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:10.947145 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-362bd276-eac8-46b8-a078-c1477d17015f admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:10.948160 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-362bd276-eac8-46b8-a078-c1477d17015f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 16 17:37:10.948600 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:10.959477 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:11.009467 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-e50002ee-c59a-484b-b1c6-26bb11bdc76d admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:11.027232 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-e50002ee-c59a-484b-b1c6-26bb11bdc76d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072787 Jun 16 17:37:11.027763 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jun 16 17:37:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:12.019240 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-362bd276-eac8-46b8-a078-c1477d17015f admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.020455 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-362bd276-eac8-46b8-a078-c1477d17015f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jun 16 17:37:12.020851 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:12.226950 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-8b496b9d-0c83-4292-acdf-3ea5878002d5 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.232514 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.wsgi [None req-8b496b9d-0c83-4292-acdf-3ea5878002d5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-8b496b9d-0c83-4292-acdf-3ea5878002d5 admin admin] Request method failure captured: Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Accept: application/json Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Accept-Encoding: gzip, deflate Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Connection: keep-alive Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Content-Length: 0 Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Host: 10.222.0.42 Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Openstack-Api-Version: compute 2.90 Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Openstack-System-Scope: None Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: User-Agent: python-novaclient Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Auth-Token: gAAAAABiq2pIFHrD6-TK_zde2opgMjV7zSwWRU0_DRY1uVPu-ECN7xSNuzWBL7o3gN4nOHnDx5oFJo8RSYBFITjkfWTGGniAlCy1YhURWOyfOuDmxNAkgxuR08G4GaBwkdxHFQpqIXf-IPBhaqIqIhc40J1FfehPVZM3QQk-4IazFokqHdELPLQ Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Domain-Id: None Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Domain-Name: None Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Identity-Status: Confirmed Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Is-Admin-Project: True Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Domain-Id: default Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Domain-Name: Default Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Name: admin Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Role: reader,admin,member Jun 16 17:37:12.235715 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Roles: reader,admin,member Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f64791acc5674278bd1baac8430d9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f64791acc5674278bd1baac8430d9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant: admin Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant-Name: admin Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User: admin Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Domain-Id: default Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Domain-Name: Default Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Id: 12a220316b144048ad50f0affd87fa43 Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Name: admin Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: method: > Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: exception: Flavor 42 could not be found. Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: action_args: {'id': '42'} Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:12.237310 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:12.239603 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.241037 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-8b496b9d-0c83-4292-acdf-3ea5878002d5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:12.242380 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-8b496b9d-0c83-4292-acdf-3ea5878002d5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063493 Jun 16 17:37:12.242380 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:12.247506 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7afbd914-9f62-4645-8a3e-a67391e5d4a7 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.250474 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:12.270768 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-7afbd914-9f62-4645-8a3e-a67391e5d4a7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026797 Jun 16 17:37:12.271321 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:12.281785 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-d8a7ae5e-7f8c-4aa4-b5c1-9ebacdbc1eda admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.303712 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-d8a7ae5e-7f8c-4aa4-b5c1-9ebacdbc1eda admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025457 Jun 16 17:37:12.304413 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:37:12.313387 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7a9e6163-6949-4a0c-98b9-1b16b3d7d501 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.320114 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.wsgi [None req-7a9e6163-6949-4a0c-98b9-1b16b3d7d501 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7a9e6163-6949-4a0c-98b9-1b16b3d7d501 admin admin] Request method failure captured: Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Accept: application/json Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Accept-Encoding: gzip, deflate Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Connection: keep-alive Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Content-Length: 0 Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Host: 10.222.0.42 Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Openstack-Api-Version: compute 2.90 Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Openstack-System-Scope: None Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: User-Agent: python-novaclient Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Auth-Token: gAAAAABiq2pIFHrD6-TK_zde2opgMjV7zSwWRU0_DRY1uVPu-ECN7xSNuzWBL7o3gN4nOHnDx5oFJo8RSYBFITjkfWTGGniAlCy1YhURWOyfOuDmxNAkgxuR08G4GaBwkdxHFQpqIXf-IPBhaqIqIhc40J1FfehPVZM3QQk-4IazFokqHdELPLQ Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Domain-Id: None Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Domain-Name: None Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Identity-Status: Confirmed Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Is-Admin-Project: True Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Domain-Id: default Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Domain-Name: Default Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Name: admin Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Role: reader,admin,member Jun 16 17:37:12.323392 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Roles: reader,admin,member Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f64791acc5674278bd1baac8430d9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f64791acc5674278bd1baac8430d9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant: admin Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant-Name: admin Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User: admin Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Domain-Id: default Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Domain-Name: Default Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Id: 12a220316b144048ad50f0affd87fa43 Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Name: admin Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: method: > Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: exception: Flavor 42 could not be found. Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: action_args: {'id': '42'} Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:12.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:12.325840 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:12.326854 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7a9e6163-6949-4a0c-98b9-1b16b3d7d501 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:12.327880 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-7a9e6163-6949-4a0c-98b9-1b16b3d7d501 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014891 Jun 16 17:37:12.327880 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 17:37:13.199408 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-d8a7ae5e-7f8c-4aa4-b5c1-9ebacdbc1eda admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:13.200432 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-d8a7ae5e-7f8c-4aa4-b5c1-9ebacdbc1eda admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 16 17:37:13.200834 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:13.392005 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-be4ef620-cb80-4396-8dd3-578723e64374 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:13.398554 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.wsgi [None req-be4ef620-cb80-4396-8dd3-578723e64374 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-be4ef620-cb80-4396-8dd3-578723e64374 admin admin] Request method failure captured: Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Accept: application/json Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Accept-Encoding: gzip, deflate Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Connection: keep-alive Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Content-Length: 0 Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Host: 10.222.0.42 Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Openstack-Api-Version: compute 2.90 Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Openstack-System-Scope: None Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: User-Agent: python-novaclient Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Auth-Token: gAAAAABiq2pJCzqnbz01dfnsY0qRTYbZJqFGhd4x_3gqiEavoc5ZbeTErFnVkj-9F9RqGg5CJ9fJoSxa5iP2_HyzoFJFkNfSlybKaJBZ2sL2jUQU7wd6OqC0aiejji8WZ-da6Pv8_l3_hYijjF-VW7f7e4ZFgt231rc668MlYm6igsM2RFBPFMw Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Domain-Id: None Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Domain-Name: None Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Identity-Status: Confirmed Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Is-Admin-Project: True Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Domain-Id: default Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Domain-Name: Default Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Name: admin Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Role: reader,admin,member Jun 16 17:37:13.400040 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Roles: reader,admin,member Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f64791acc5674278bd1baac8430d9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f64791acc5674278bd1baac8430d9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant: admin Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant-Name: admin Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User: admin Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Domain-Id: default Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Domain-Name: Default Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Id: 12a220316b144048ad50f0affd87fa43 Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Name: admin Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: method: > Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: exception: Flavor 84 could not be found. Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: action_args: {'id': '84'} Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:13.401605 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:13.402653 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.404061 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-be4ef620-cb80-4396-8dd3-578723e64374 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:13.405401 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-be4ef620-cb80-4396-8dd3-578723e64374 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061512 Jun 16 17:37:13.405401 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jun 16 17:37:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:13.411748 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-9c1039b0-8343-4c2e-be29-13aef7aac40e admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:13.425243 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-9c1039b0-8343-4c2e-be29-13aef7aac40e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017866 Jun 16 17:37:13.425977 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jun 16 17:37:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:13.435134 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-2c8af269-8a09-42e6-9875-6c7ac3966d3a admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:13.448763 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-2c8af269-8a09-42e6-9875-6c7ac3966d3a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017031 Jun 16 17:37:13.449278 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jun 16 17:37:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:37:13.458765 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-79272681-26d3-473f-831d-92a6b8d0e170 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:13.464054 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.wsgi [None req-79272681-26d3-473f-831d-92a6b8d0e170 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-79272681-26d3-473f-831d-92a6b8d0e170 admin admin] Request method failure captured: Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Accept: application/json Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Accept-Encoding: gzip, deflate Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Connection: keep-alive Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Content-Length: 0 Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Host: 10.222.0.42 Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Openstack-Api-Version: compute 2.90 Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Openstack-System-Scope: None Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: User-Agent: python-novaclient Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Auth-Token: gAAAAABiq2pJCzqnbz01dfnsY0qRTYbZJqFGhd4x_3gqiEavoc5ZbeTErFnVkj-9F9RqGg5CJ9fJoSxa5iP2_HyzoFJFkNfSlybKaJBZ2sL2jUQU7wd6OqC0aiejji8WZ-da6Pv8_l3_hYijjF-VW7f7e4ZFgt231rc668MlYm6igsM2RFBPFMw Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Domain-Id: None Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Domain-Name: None Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Identity-Status: Confirmed Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Is-Admin-Project: True Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Domain-Id: default Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Domain-Name: Default Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Name: admin Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Role: reader,admin,member Jun 16 17:37:13.465589 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Roles: reader,admin,member Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f64791acc5674278bd1baac8430d9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f64791acc5674278bd1baac8430d9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant: admin Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant-Name: admin Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User: admin Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Domain-Id: default Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Domain-Name: Default Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Id: 12a220316b144048ad50f0affd87fa43 Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Name: admin Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: method: > Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: exception: Flavor 84 could not be found. Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: action_args: {'id': '84'} Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:13.467093 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:13.468119 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:13.469574 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-79272681-26d3-473f-831d-92a6b8d0e170 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:13.470854 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-79272681-26d3-473f-831d-92a6b8d0e170 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012293 Jun 16 17:37:13.470854 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jun 16 17:37:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:14.381398 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-2c8af269-8a09-42e6-9875-6c7ac3966d3a admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:14.382391 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-2c8af269-8a09-42e6-9875-6c7ac3966d3a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 16 17:37:14.382778 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:14.579781 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-1dff2309-bba7-4f94-94be-3828f9b5cf10 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:14.587134 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.wsgi [None req-1dff2309-bba7-4f94-94be-3828f9b5cf10 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-1dff2309-bba7-4f94-94be-3828f9b5cf10 admin admin] Request method failure captured: Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Accept: application/json Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Accept-Encoding: gzip, deflate Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Connection: keep-alive Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Content-Length: 0 Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Host: 10.222.0.42 Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Openstack-Api-Version: compute 2.90 Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Openstack-System-Scope: None Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: User-Agent: python-novaclient Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Auth-Token: gAAAAABiq2pK6_-t-loMPAa_uASHJK6jfUKrhmic-znqVmsRBe53ugchaPBBY69IxbsxIWyYGOwqJmmlljekr1W1KthE2HP2MHGW-LOsUWbaXm2nV9up_67yfNqv5YZug5_TXzSkiS94SvbcRJpc6Oo0ieEKf_FrC9MIKdKRgJH42ePOQ9l-T5c Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Domain-Id: None Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Domain-Name: None Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Identity-Status: Confirmed Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Is-Admin-Project: True Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Domain-Id: default Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Domain-Name: Default Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Project-Name: admin Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Role: reader,admin,member Jun 16 17:37:14.588654 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Roles: reader,admin,member Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f64791acc5674278bd1baac8430d9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f64791acc5674278bd1baac8430d9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant: admin Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-Tenant-Name: admin Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User: admin Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Domain-Id: default Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Domain-Name: Default Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Id: 12a220316b144048ad50f0affd87fa43 Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: X-User-Name: admin Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: method: > Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: exception: Flavor 451 could not be found. Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: action_args: {'id': '451'} Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:14.590163 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:14.590976 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.592087 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-1dff2309-bba7-4f94-94be-3828f9b5cf10 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:14.593122 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-1dff2309-bba7-4f94-94be-3828f9b5cf10 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064461 Jun 16 17:37:14.593122 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jun 16 17:37:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:14.600152 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-c16d1be4-ee2e-4c82-bdd5-0be2490baa0d admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:14.615543 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-c16d1be4-ee2e-4c82-bdd5-0be2490baa0d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019507 Jun 16 17:37:14.616066 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jun 16 17:37:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:14.625551 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:14.639443 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017480 Jun 16 17:37:14.639980 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jun 16 17:37:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:14.649652 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7ecb78ac-b822-46d2-8293-ceffb6203b9c admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:14.655010 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.wsgi [None req-7ecb78ac-b822-46d2-8293-ceffb6203b9c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7ecb78ac-b822-46d2-8293-ceffb6203b9c admin admin] Request method failure captured: Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Accept: application/json Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Accept-Encoding: gzip, deflate Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Connection: keep-alive Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Content-Length: 0 Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Host: 10.222.0.42 Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Openstack-Api-Version: compute 2.90 Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Openstack-System-Scope: None Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: User-Agent: python-novaclient Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Auth-Token: gAAAAABiq2pK6_-t-loMPAa_uASHJK6jfUKrhmic-znqVmsRBe53ugchaPBBY69IxbsxIWyYGOwqJmmlljekr1W1KthE2HP2MHGW-LOsUWbaXm2nV9up_67yfNqv5YZug5_TXzSkiS94SvbcRJpc6Oo0ieEKf_FrC9MIKdKRgJH42ePOQ9l-T5c Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Domain-Id: None Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Domain-Name: None Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Identity-Status: Confirmed Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Is-Admin-Project: True Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Domain-Id: default Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Domain-Name: Default Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Project-Name: admin Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Role: reader,admin,member Jun 16 17:37:14.656524 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Roles: reader,admin,member Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f64791acc5674278bd1baac8430d9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f64791acc5674278bd1baac8430d9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f64791acc5674278bd1baac8430d9719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant: admin Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant-Id: f64791acc5674278bd1baac8430d9719 Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-Tenant-Name: admin Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User: admin Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Domain-Id: default Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Domain-Name: Default Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Id: 12a220316b144048ad50f0affd87fa43 Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: X-User-Name: admin Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: method: > Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: exception: Flavor 451 could not be found. Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: action_args: {'id': '451'} Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:14.657959 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:14.658742 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: ERROR nova.api.openstack.wsgi Jun 16 17:37:14.660734 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-7ecb78ac-b822-46d2-8293-ceffb6203b9c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:14.661948 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-7ecb78ac-b822-46d2-8293-ceffb6203b9c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011719 Jun 16 17:37:14.661948 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jun 16 17:37:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 17:37:15.534075 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:15.535804 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jun 16 17:37:15.536208 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:15.729549 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-9a912a07-5e71-46d9-8416-86624632dbec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:15.747283 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-9a912a07-5e71-46d9-8416-86624632dbec admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069979 Jun 16 17:37:15.747824 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jun 16 17:37:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:37:16.639909 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:16.640953 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 16 17:37:16.641355 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:16.833850 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-47702754-986b-4d69-b61e-2fd3ec5dbf23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:16.851674 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-47702754-986b-4d69-b61e-2fd3ec5dbf23 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070528 Jun 16 17:37:16.852146 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jun 16 17:37:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:37:17.757534 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:17.758538 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 16 17:37:17.758942 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:17.953454 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-52d3df68-1225-4b03-9736-f74ae8ea2544 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:17.971024 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-52d3df68-1225-4b03-9736-f74ae8ea2544 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070739 Jun 16 17:37:17.971576 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jun 16 17:37:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:37:18.859640 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:18.860666 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Jun 16 17:37:18.861066 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:19.060153 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-abe23d1d-a60f-4e47-a2aa-01266719b480 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:19.077800 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-abe23d1d-a60f-4e47-a2aa-01266719b480 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070732 Jun 16 17:37:19.078282 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jun 16 17:37:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:37:19.953140 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:19.954148 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 16 17:37:19.954551 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:20.158850 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-12b2fa4b-604d-4eff-92a1-a35e9d7a621c admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:20.179474 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-12b2fa4b-604d-4eff-92a1-a35e9d7a621c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083066 Jun 16 17:37:20.180006 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Jun 16 17:37:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:08.909304 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:08.910329 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-0dd599af-7491-491c-a52d-2b430476d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 16 17:38:08.910761 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jun 16 17:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:08.921507 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:08.970328 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-c1d03313-cf5c-4dfa-b2eb-e0ba59a76800 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:08.989648 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-c1d03313-cf5c-4dfa-b2eb-e0ba59a76800 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072844 Jun 16 17:38:08.990175 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jun 16 17:38:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:09.010810 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG dbcounter [-] [109772] Writing DB stats nova_api:SELECT=14 {{(pid=109772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:09.015355 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-46655d11-10de-4b3e-9838-27194f8117f6 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:09.022937 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-46655d11-10de-4b3e-9838-27194f8117f6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013245 Jun 16 17:38:09.023457 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Thu Jun 16 17:38:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:09.035281 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-42420115-8800-4f8e-9027-ac307b62a239 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:09.042923 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-42420115-8800-4f8e-9027-ac307b62a239 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011169 Jun 16 17:38:09.043422 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Thu Jun 16 17:38:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:09.054869 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:09.062588 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011254 Jun 16 17:38:09.063098 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Thu Jun 16 17:38:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:09.073875 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-34e8ab37-3ff3-47b9-8795-f935318d5fd9 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:09.081829 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-34e8ab37-3ff3-47b9-8795-f935318d5fd9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011363 Jun 16 17:38:09.082339 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Thu Jun 16 17:38:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:45.305444 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:45.306452 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 16 17:41:45.306848 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:45.469689 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_api:SELECT=6 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:45.600388 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-44d1ca2d-f48b-4265-a1dd-0fae9a7b2f6e admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:45.601555 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:41:45.601555 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: warnings.warn(msg) Jun 16 17:41:45.602829 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-44d1ca2d-f48b-4265-a1dd-0fae9a7b2f6e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:45.603269 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-44d1ca2d-f48b-4265-a1dd-0fae9a7b2f6e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:45.604046 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-44d1ca2d-f48b-4265-a1dd-0fae9a7b2f6e admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:45.604528 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-44d1ca2d-f48b-4265-a1dd-0fae9a7b2f6e admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:45.638706 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-44d1ca2d-f48b-4265-a1dd-0fae9a7b2f6e admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.170396 Jun 16 17:41:45.639314 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jun 16 17:41:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:41:46.537006 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:46.538001 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 17:41:46.538389 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:46.729462 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-338aecc8-e917-4d54-85b1-71edb7dae52b admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:46.730646 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:41:46.730646 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: warnings.warn(msg) Jun 16 17:41:46.731820 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-338aecc8-e917-4d54-85b1-71edb7dae52b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:46.732247 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-338aecc8-e917-4d54-85b1-71edb7dae52b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:46.733109 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-338aecc8-e917-4d54-85b1-71edb7dae52b admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:46.733536 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-338aecc8-e917-4d54-85b1-71edb7dae52b admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:46.753896 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-338aecc8-e917-4d54-85b1-71edb7dae52b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076404 Jun 16 17:41:46.754362 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jun 16 17:41:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:41:58.079312 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:58.080314 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 16 17:41:58.080777 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:58.224305 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_cell0:SELECT=4 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:58.225038 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_cell1:SELECT=4 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:58.225705 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG dbcounter [-] [109771] Writing DB stats nova_api:SELECT=8 {{(pid=109771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:58.274940 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-c940c51d-2faf-49b1-bbdc-69a328b629e2 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:58.276103 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:41:58.276103 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: warnings.warn(msg) Jun 16 17:41:58.277301 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-c940c51d-2faf-49b1-bbdc-69a328b629e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:58.277741 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-c940c51d-2faf-49b1-bbdc-69a328b629e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:58.278516 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-c940c51d-2faf-49b1-bbdc-69a328b629e2 admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:58.278942 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-c940c51d-2faf-49b1-bbdc-69a328b629e2 admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:58.303668 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-c940c51d-2faf-49b1-bbdc-69a328b629e2 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083830 Jun 16 17:41:58.304205 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jun 16 17:41:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:59.187258 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: DEBUG nova.api.openstack.wsgi [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] Calling method '>' {{(pid=109772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:59.188255 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: INFO nova.api.openstack.requestlog [None req-91833a18-fc27-4546-9dc8-b8ee07e636c9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 17:41:59.188686 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: [pid: 109772|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jun 16 17:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:59.384746 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG nova.api.openstack.wsgi [None req-571c2a71-2752-4845-988b-688f48f4e862 admin admin] Calling method '>' {{(pid=109771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:59.385903 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:41:59.385903 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: warnings.warn(msg) Jun 16 17:41:59.387081 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-571c2a71-2752-4845-988b-688f48f4e862 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:59.387511 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-571c2a71-2752-4845-988b-688f48f4e862 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:59.388275 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-571c2a71-2752-4845-988b-688f48f4e862 admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:59.388718 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: DEBUG oslo_concurrency.lockutils [None req-571c2a71-2752-4845-988b-688f48f4e862 admin admin] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:59.411137 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: INFO nova.api.openstack.requestlog [None req-571c2a71-2752-4845-988b-688f48f4e862 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080006 Jun 16 17:41:59.412005 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: [pid: 109771|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jun 16 17:41:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:43:00.015735 dv-cinder-837542-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 17:43:00.016301 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: Thu Jun 16 17:43:00 2022 - graceful shutdown triggered... Jun 16 17:43:00.016783 dv-cinder-837542-4-iscsi devstack@n-api.service[109772]: Gracefully killing worker 2 (pid: 109772)... Jun 16 17:43:00.017138 dv-cinder-837542-4-iscsi devstack@n-api.service[109771]: Gracefully killing worker 1 (pid: 109771)... Jun 16 17:43:01.016575 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: worker 1 buried after 1 seconds Jun 16 17:43:01.016575 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: worker 2 buried after 1 seconds Jun 16 17:43:01.016575 dv-cinder-837542-4-iscsi devstack@n-api.service[109770]: goodbye to uWSGI. Jun 16 17:43:01.018774 dv-cinder-837542-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 17:43:01.019336 dv-cinder-837542-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 17:43:01.022107 dv-cinder-837542-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:43:01.043441 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:43:01 2022] *** Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: nodename: dv-cinder-837542-4-iscsi Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: machine: x86_64 Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: clock source: unix Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: pcre jit disabled Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: detected number of CPU cores: 4 Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: current working directory: / Jun 16 17:43:01.045330 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: your processes number limit is 47680 Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: your memory page size is 4096 bytes Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: detected max file descriptor number: 2048 Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: lock engine: pthread robust mutexes Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: thunder lock: enabled Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:43:01.046094 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:43:01.090984 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: Python main interpreter initialized at 0x5600b39af9c0 Jun 16 17:43:01.090984 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: python threads support enabled Jun 16 17:43:01.090984 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: your server socket listen backlog is limited to 100 connections Jun 16 17:43:01.090984 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:43:01.091483 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:43:01.091483 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: *** Operational MODE: preforking *** Jun 16 17:43:01.091699 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:43:01.091699 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: spawned uWSGI master process (pid: 124142) Jun 16 17:43:01.091905 dv-cinder-837542-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:43:01.092786 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: spawned uWSGI worker 1 (pid: 124157, cores: 1) Jun 16 17:43:01.092912 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: spawned uWSGI worker 2 (pid: 124158, cores: 1) Jun 16 17:43:01.093050 dv-cinder-837542-4-iscsi devstack@n-api.service[124142]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:43:01.764519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:43:01.789026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:43:03.039366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:43:03.039366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: from cryptography.utils import int_from_bytes Jun 16 17:43:03.039998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:43:03.039998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: from cryptography.utils import int_from_bytes Jun 16 17:43:03.099122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:43:03.099122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: from cryptography.utils import int_from_bytes Jun 16 17:43:03.099786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:43:03.099786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: from cryptography.utils import int_from_bytes Jun 16 17:43:05.487540 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:43:05.488160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:43:05.488355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:43:05.488766 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:43:05.489005 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:43:05.489398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.489727 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.490058 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.490383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.490715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.491028 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.491358 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.491689 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.492026 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.492292 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.492642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.492971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-4-iscsi {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.493295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.493617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.493933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.494260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.494570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.494896 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.495206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.495720 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.496528 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.496851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.497176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.497529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.497851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.498168 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.498496 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.499154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.499500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.499818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.500249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-4-iscsi {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.500607 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.500918 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.501239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.501717 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.502036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.502350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.502778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.503385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.504040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.504040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.504355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.504704 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.505029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.505340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.505656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.505973 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.506297 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.506607 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.506917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.507191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.507478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.507807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.508530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.508727 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.509043 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.509230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.509552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.509878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.510191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.510506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.510814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.511120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.511426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.511733 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.512041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.512350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.512698 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.513019 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.513355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.513666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.513991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.514406 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.514738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.515065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.515416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.515741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.516055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.516417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.516731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.517586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.518141 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.518500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.518832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.519183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.519498 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.519757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.520068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.520399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.520724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.521037 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.521349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.521662 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.521968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.522278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.522587 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.522897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.523206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.523515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.523832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.524142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.524486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.524798 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.525124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.525450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.525759 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.526068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.526377 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.526686 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.527012 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.527323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.527633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.527958 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.528268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.528615 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.528938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.529251 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.529564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.529889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.530194 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.530505 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.530827 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.531139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.531451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.531760 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.532068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.532402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.533312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.533674 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.533994 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.534305 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.534633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.534960 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.535278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.535590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.535899 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.536222 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.536596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.536933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.537284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.537604 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.537943 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.538281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.538603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.538921 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.539239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.539570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.539906 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.540205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.540547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.540871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.541192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.541524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.541844 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.542167 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.542489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.542803 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.543124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.543457 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.543792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.544106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.544478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.544829 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.545149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.545478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.545809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.546125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.546442 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.546756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.547083 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.547419 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.547735 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.548057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.548691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.549099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.549428 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.549745 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.550065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.550405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.550725 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.551045 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.551364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.551688 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.552005 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.552321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.552660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.552972 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.553282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.553595 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.553923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.554236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.554564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.554897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.555208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.555547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.555860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.556176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.556516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.556834 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.557143 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.557459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.557774 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.558084 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.558411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.558724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.559035 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.559360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.559669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.559991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.560315 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.560636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.560950 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.561264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.561581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.561906 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.562221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.562536 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.562872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.563209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.563515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.563848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.564366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.564593 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.564889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.565204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.565514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.565824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.566134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.566448 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.566757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.567070 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.567379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.567687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.567997 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.568322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.568659 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.568968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.569276 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.569584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.569932 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.570260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.570590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.570925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.571247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.571575 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.571888 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.572205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.572543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.572860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.573178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.573487 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.573815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.574128 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.574451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.574764 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.575092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.575407 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.575731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.576042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.576362 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.576726 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.577288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.577437 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.577765 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.578081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.578399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.578714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.579028 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.579341 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.580176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.580542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.580901 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.581225 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.581540 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.581868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.582181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.582505 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.582814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.583133 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.583466 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.583800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.584112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.584453 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.584784 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.585101 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.585416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.585732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.586041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.586352 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.586665 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.586984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.587300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.587615 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.587922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.588239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.588585 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.588896 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.589201 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.589516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.589840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.590152 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.590479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.590802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.591108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.591416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.591741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.592053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.592357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.592686 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.592994 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.593337 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.593651 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.593960 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.594286 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.594610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.594925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.595366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.595781 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.596105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.596455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.596778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.597091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.597405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.597720 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.598034 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.598348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.598674 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.598990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.599304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.599618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.599925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.600236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.601042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.601201 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.601540 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.601802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.602272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.602555 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.602962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.603331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.603778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.604366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.604705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.605067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.605434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.605759 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.606104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.606453 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.606770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.607151 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.607473 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.607815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.608159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.608565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.608892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.609245 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.609591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.609905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.610220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.610538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.611387 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.611691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.612002 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.612514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.612875 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.613190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.613533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.613867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.614216 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.614528 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.614844 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.615271 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.615495 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.615804 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.616114 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.616452 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.616772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.617082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.617398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.617711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.618027 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.618341 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.618650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.618964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.619324 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.619596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.619912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.620219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.620550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.620866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.621178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.621505 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.621808 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.622115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.622436 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.622747 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.623059 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.623369 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.623685 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.624062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.624397 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.624728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.625049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.625363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.625671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.625986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.626296 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.626785 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.627105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.627433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.627756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.628066 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.628380 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:43:05.628807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.628905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:43:05.628992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.628992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.629173 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:43:05.629304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.629529 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:43:05.629630 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.629790 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:43:05.629913 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.630183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.630277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.630518 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.630619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.630826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.630918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.631134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.631236 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.631459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.631553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.631776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.631957 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.632108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.632261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.632444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.632605 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.632750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.632910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.633062 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.633478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.633633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.633785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.633939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-4-iscsi {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.634082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.634234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.634386 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.634539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.635130 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.635299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.635463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.635715 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.635943 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.636107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.636261 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.636461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.636621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.636778 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.636933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.636933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.637209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.637387 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.637553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.638199 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.638367 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.638516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.638672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.638819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.638974 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.639121 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.639265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.639428 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.639654 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.639814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.639969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.640118 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.640276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.640445 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.640615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.640769 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.640915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.641061 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.641221 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-4-iscsi {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.641368 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.641512 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.641657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.641827 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.641979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.642665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.642868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.642868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.643199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.643287 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.643389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.643487 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.643582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.643677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.643677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.643677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.643909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.644076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.644173 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.644266 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.644359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.644473 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.644577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.644665 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.644757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.644895 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.645069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.645235 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.645406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.645559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.645736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.646072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.646233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.646394 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.646561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.646714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.646866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.647025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.647645 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.647819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.647984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.648137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.648290 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.648482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.648677 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.648849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.649005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.649166 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.649326 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.649479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.649656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.649900 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.650066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.650066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.650368 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.650520 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.650708 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.650869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.651024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.651183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.651335 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.651496 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.651658 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.651826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.651979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.652130 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.652289 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.652475 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.652660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.652853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.653007 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.653167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.653327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.653487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.653654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.653814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.653965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.654117 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.654277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.654438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.654599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.654764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.654924 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.655076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.655228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.655393 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.655554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.655715 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.655874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.656187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.656351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.656546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.656703 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.656863 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.657037 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.657199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.657351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.657516 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.657675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.657895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.658047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.658198 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.658512 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.658679 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.658841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.658994 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.659163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.659324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.659491 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.659491 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.659788 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.660028 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.660187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.660347 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.660546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.660715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.660874 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.661026 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.661177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.661349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.661513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.661665 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.661816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.661968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.662119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.662279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.662439 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.662439 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.662744 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.662896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.663055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.663220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.663383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.663533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.663693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.663845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.664004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.664164 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.664323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.664500 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.664653 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.664822 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.664982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.665150 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.665302 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.665471 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.665623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.665774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.665935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.666096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.666424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.666424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.666721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.666881 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.667048 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.667048 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.667344 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.667506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.667677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.667677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.667965 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.668116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.668275 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.668494 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.668655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.668807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.668966 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.669125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.669285 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.669450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.669613 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.669772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.669924 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.670159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.670336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.670504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.670657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.670826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.670988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.671147 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.671321 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.671527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.671682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.671858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.672012 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.672171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.672338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.672518 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.672672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.672823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.672976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.672976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.673802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.673976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.674278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.674435 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.674601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.674763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.674918 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.675079 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.675238 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.675391 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.675543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.675704 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.675864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.676023 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.676182 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.676416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.676591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.676591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.676911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.677090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.677090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.677383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.677543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.677706 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:43:05.677865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678494 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678817 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.678968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.679118 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.679276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.679529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.679690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.679851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.680004 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.680184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.680426 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.680601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.680762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.680936 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.681099 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.681259 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.681259 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.681575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.681575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.681879 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682033 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682518 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682676 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.682840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.683137 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.683300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.683460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.683611 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.683762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.683914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.684066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.684231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.684402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.684572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.684733 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.684904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.685067 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.685227 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.685387 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.685539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.685690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.685848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.686010 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.686171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.686329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.686489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.686642 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.686801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687370 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.687991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.688153 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.688304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.688490 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.688644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.688812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.689561 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.689766 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.689923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.690157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.690329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.690624 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.690792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.690955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.691110 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.691263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.691430 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.691600 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.691753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.691925 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692729 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.692880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.693177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.693348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.693509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.693661 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.693812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.693983 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.694146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.694312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.694466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.694617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.694781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.694933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.695084 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.695260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.695422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.695582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.695742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.695917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.696079 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.696231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.696401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.696573 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.696733 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.696892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.697103 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.697263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.697415 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.697567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.697725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.697890 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.698055 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.698215 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.698375 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.698527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.698689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.698850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699010 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699466 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699617 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.699955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.700108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.700274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.700471 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.700712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.700885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701039 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701039 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701335 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701667 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701831 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.701996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.702149 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.702307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.702460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.702621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.702774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.702935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.703094 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.703245 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.703404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.703576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.703728 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.703881 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.704051 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.704204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.704355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.704589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.704751 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.704982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.705153 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.705376 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.705533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.705729 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.705891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.706045 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.706204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.706369 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.706530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.706691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.706880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707667 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.707985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.708145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.708145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.708486 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.708652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.708811 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.708962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.709128 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.709288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.709450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.709602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.709762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.709914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.710065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.710231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.710397 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.710557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.710727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.710960 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.711119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.711289 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.711446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.711605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.711766 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.711926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.712085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.712248 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.712464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.712648 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.712810 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.712962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713442 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.713915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.714211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.714363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.714513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.714684 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.714843 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715162 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.715958 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.716110 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.716270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.716445 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.716604 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.716777 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.716940 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.717092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.717251 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.717410 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.717564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.717793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.717957 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.718116 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.718277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.718436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.718589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.718762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.718917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.719068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.719219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.719379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.719531 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.719696 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.719855 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.720014 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.720220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.720410 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.720602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.720774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.720965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.721197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.721354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.721506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.721673 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.721827 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.721984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.722144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.722144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.722440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.722601 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.722755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.722914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.723082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.723234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.723393 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.723554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.723714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.723866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.724025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.724177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.724344 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.724572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.724727 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.724880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725203 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725368 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725523 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725683 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.725989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.726146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.726315 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.726468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.726628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.726781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.726934 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.727097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.727262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.727416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.727568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.727719 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.727871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.728031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.728197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.728356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.728538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.728705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.728892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.729056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.729234 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.729398 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.729550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.729710 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.729873 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730346 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730498 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730812 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.730978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.731148 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.731387 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.731544 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.731712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.731872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.732026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.732185 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.732338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.732551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.732721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.732873 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733350 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.733978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.734129 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.734281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.734446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.734599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.734751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.734902 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.735061 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.735220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.735398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.735559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.735712 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.736402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.736563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.736727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.736891 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.737045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.737204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.737356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.737517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.737679 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.737859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738012 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738172 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738332 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738487 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.738953 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.739111 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.739264 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.739416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.739582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.739742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.739911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.740446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.741431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.741590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.741742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.741902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.742073 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.742233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.742399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.742552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.742705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.742868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743350 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743801 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.743962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.744122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.744285 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.744285 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.744604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.744757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.744919 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.745086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.745239 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.745399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.745558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.745717 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.745870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.746047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.746207 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.746367 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.746519 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.746678 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.746839 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747797 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.747951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.748123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.748275 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.748460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.748627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.748787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.748947 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.749107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.749260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.749423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.749583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.749734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.749885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750201 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750367 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750521 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750671 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750830 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.750981 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.751154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.751310 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.751524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.751692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.751847 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.752008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.752187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.752340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.752550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.752705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.752865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.753981 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.754140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.754311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.754463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.754615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.754775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.754946 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.755100 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.755253 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.755411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.755411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.755411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.755862 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.756024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.756189 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.756349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.756530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.756693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.756860 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757324 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.757942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.758352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.758522 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.758681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.758843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.758996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.759147 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.759306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.759459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.759617 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.759780 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.759932 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.760095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.760248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.760433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.760594 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.760763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.760924 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761093 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.761260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.762406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.763545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.763545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.763545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.763545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.764127 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.764127 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.764470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.764638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.764939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.765588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.765588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.765892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.766149 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.766469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.766784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.767673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.768223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.768821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.769398 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.769981 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.770566 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.771121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.771711 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.772334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.772972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.773313 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.773641 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.775100 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.775470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.775808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.777596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.777596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.777596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.778004 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.778081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.778375 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.778709 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.779037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.779369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.779695 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.780015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.781865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.782197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.782546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.784049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.784409 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.786318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.786669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.787020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.787355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.787684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.788027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.788338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.788689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.789015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.789340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.789666 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.789991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.790314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.790640 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.790961 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.791284 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.791606 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.791923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.792263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.792609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.792925 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.793247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.793565 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.793886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.794213 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.794648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.794972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.795290 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.795609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.796030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.796252 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.796601 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.796930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.797252 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.797681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.798008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.798364 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.799219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.799544 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.799865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.800192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.800560 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.800883 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.801201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.801517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.801852 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.802170 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.802504 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.802936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.803286 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.803573 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.805071 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.805346 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.805792 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.806230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.806587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.806932 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.807261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.807594 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.807920 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.808265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.808630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.808953 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.809282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.809599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.809937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.810271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.810599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.810934 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.811362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.811697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.812020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.812355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.812710 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.813029 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.813345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.813665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.814078 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.814889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.815236 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.815563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.815892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.816217 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.816567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.816888 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.817208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.817550 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.817868 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.818207 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.818532 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.818863 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.819196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.819528 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.819848 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.820167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.820504 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.820824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.821138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.821494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.821814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.822009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO dbcounter [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Registered counter for database nova_api Jun 16 17:43:05.822161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.822477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.822818 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.823140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.823484 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.823824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.824201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.824514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.824853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.825168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.825483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.825801 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.826116 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.826436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.826747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.827060 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.827377 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.827690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.828003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.828340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.828787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.829036 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.829354 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.830183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.831090 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.831414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.831771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.832091 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.832571 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.832912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.833245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.833588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.833912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.834249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.834649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.834938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.835218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.835543 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.835877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.836201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.836557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.836882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.837208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.837537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.838086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.838515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.838947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.839124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.839399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.839729 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.840055 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.840407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.840728 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.841053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.841376 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.841698 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.842038 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.842371 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.842709 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.843049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:05.843165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.843378 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.843706 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.844035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.844363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.844754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.845082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.846464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.846814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.847147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.847481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.847804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.848134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.848485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.848813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.849136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.849458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.849785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.850111 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.850447 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.850792 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.850896 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writer thread running {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:05.851123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.851446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.851769 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.852094 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.852681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.853009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.853352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.853688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.854022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.854349 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.854681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.855021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.855337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.855653 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.855998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.856288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.856626 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.856959 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.857281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.857594 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.857930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.858249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.858794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.859155 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.859830 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.859830 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.860142 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.860467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.860812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.861741 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.862074 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.863157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.863157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.863157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.863637 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.863792 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.863987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.864311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.864653 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.864979 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.865293 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.865631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.865948 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.866268 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.866581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.866901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.867215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.867530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.867846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.868164 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.869787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.869787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.869787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.869787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.869787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.870551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.870551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.870836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.871026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.871339 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.871656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.871984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.872303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.872665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.872986 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.873306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.873675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.874006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.874582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.874923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.875256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.875609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.875950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.876267 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.876632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.877532 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.877872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.878197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.878527 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.878851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.879190 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.879742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.880322 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.880322 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.880588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.880882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.881064 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.881383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.881770 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.882012 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.882336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.882930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.883042 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.883577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.883904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.884228 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.884571 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.884894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.885225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.885612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.886274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.886274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.886503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.886786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.887219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.887542 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.887871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.888206 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.888551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.888881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.889212 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.889537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.889861 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.890181 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.890520 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.890874 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.891210 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.891546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.891860 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.893257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.893604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.893928 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.894261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.894581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.894895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.895209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.895531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.895845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.896156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.896495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.896815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.897135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.897446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.897759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.898070 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.898387 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.898699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.899011 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.899329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.899638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.899949 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.900259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.900594 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.900906 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.901250 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.901590 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.901914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.902245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.902561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.902891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.903210 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.903541 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.903870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.904196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.904537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.904880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.905201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.905523 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.905841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.907168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.907168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.907168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.907168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.907511 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.907785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.908695 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.909029 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.909365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.909705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.910144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.910588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.910816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.911968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.911968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.911968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.912464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.912622 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.context [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3bf93b-fd76-402a-824a-0db7ba7f07c6(cell1) {{(pid=124158) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:43:05.912779 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.912930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.913150 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.913798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.913798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.914204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.914463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.914811 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.915178 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.915497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.915837 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.916165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.920412 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.920412 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:43:05.920412 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:43:05.920700 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:05.921753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:05.922645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:05.924831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:05.926883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO dbcounter [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Registered counter for database nova_cell0 Jun 16 17:43:05.930903 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO dbcounter [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Registered counter for database nova_cell1 Jun 16 17:43:05.941629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:05.942970 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:05.949794 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writer thread running {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:05.951177 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writer thread running {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:05.984032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO dbcounter [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Registered counter for database nova_api Jun 16 17:43:06.005453 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:06.012692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writer thread running {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:06.082534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.context [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3bf93b-fd76-402a-824a-0db7ba7f07c6(cell1) {{(pid=124157) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:43:06.086804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:06.088428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:06.089263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:06.091240 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:06.093287 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO dbcounter [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Registered counter for database nova_cell0 Jun 16 17:43:06.098792 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO dbcounter [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Registered counter for database nova_cell1 Jun 16 17:43:06.105432 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO dbcounter [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Registered counter for database nova_cell0 Jun 16 17:43:06.106242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:06.109771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:06.115039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:06.118302 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writer thread running {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:06.119586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writer thread running {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:06.120231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writer thread running {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:06.278189 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO dbcounter [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Registered counter for database nova_cell0 Jun 16 17:43:06.285275 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:43:06.289926 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writer thread running {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:43:06.447769 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: WARNING keystonemiddleware.auth_token [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:43:06.455671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: WARNING keystonemiddleware.auth_token [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:43:06.639225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: WARNING keystonemiddleware.auth_token [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:43:06.648104 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: WARNING keystonemiddleware.auth_token [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:43:06.797548 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: WARNING keystonemiddleware.auth_token [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:43:06.804326 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: WARNING keystonemiddleware.auth_token [None req-7a9f696a-61c8-4c12-abe5-9e91c6102ab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:43:06.809857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600b39af9c0 pid: 124158 (default app) Jun 16 17:43:07.012135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: WARNING keystonemiddleware.auth_token [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:43:07.019167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: WARNING keystonemiddleware.auth_token [None req-cc5e56da-3ea2-4e62-b1b5-f7426cb9a105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:43:07.024514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600b39af9c0 pid: 124157 (default app) Jun 16 17:43:50.616757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:50.619559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:50.622735 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:50.627880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:50.999767 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0663074a-48d9-4d65-b2e2-280757a3bc50 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e191430>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:51.616212 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0663074a-48d9-4d65-b2e2-280757a3bc50 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6960a99f-bd4a-4027-9bcc-6c428114d25c" status: 200 len: 349 microversion: 2.1 time: 1.010994 Jun 16 17:43:51.620426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 1/1] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:43:50 2022] GET /compute/v2.1/os-volumes/6960a99f-bd4a-4027-9bcc-6c428114d25c => generated 349 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:53.540612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:53.543055 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:53.544123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:53.544722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:53.931136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cec29a40-e123-4b69-9115-cd5934a3010e tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e1921f0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:54.585630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cec29a40-e123-4b69-9115-cd5934a3010e tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79baa973-40e7-4198-a318-6e652e3e43a5" status: 200 len: 351 microversion: 2.1 time: 1.082515 Jun 16 17:43:54.586608 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:43:53 2022] GET /compute/v2.1/os-volumes/79baa973-40e7-4198-a318-6e652e3e43a5 => generated 351 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:56.359703 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e2bb07db-9441-49c5-bcd0-8a8ef781cd58 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e04f5e0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:56.450538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e2bb07db-9441-49c5-bcd0-8a8ef781cd58 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/23c8bd26-3474-4147-837e-fa9f94e9bb6f" status: 200 len: 351 microversion: 2.1 time: 0.095141 Jun 16 17:43:56.451109 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:43:56 2022] GET /compute/v2.1/os-volumes/23c8bd26-3474-4147-837e-fa9f94e9bb6f => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:56.467586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a82c3b36-7d11-413f-9c80-f1af9afa2eb9 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e059550>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:56.632586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a82c3b36-7d11-413f-9c80-f1af9afa2eb9 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.172660 Jun 16 17:43:56.633775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1133 bytes} [Thu Jun 16 17:43:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:56.646571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1f1086a6-d2d0-462e-8136-9532e696d58f tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e04fca0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:56.848530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1f1086a6-d2d0-462e-8136-9532e696d58f tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.205532 Jun 16 17:43:56.857416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1148 bytes} [Thu Jun 16 17:43:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:56.863589 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5cf1ac5d-9c7c-41ea-9966-c8b7891d183a tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e00f160>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.104343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5cf1ac5d-9c7c-41ea-9966-c8b7891d183a tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.245208 Jun 16 17:43:57.105401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1133 bytes} [Thu Jun 16 17:43:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:57.121525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-df1191f2-c8fe-48e8-8cab-6d946cbb75b6 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e04fa60>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.361589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-df1191f2-c8fe-48e8-8cab-6d946cbb75b6 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.243467 Jun 16 17:43:57.368603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1166 bytes} [Thu Jun 16 17:43:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:57.382339 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a01a5669-5391-4255-8e21-b90dba301c81 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e059b80>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.603585 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a01a5669-5391-4255-8e21-b90dba301c81 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.231108 Jun 16 17:43:57.604772 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Jun 16 17:43:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:57.620199 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-869e70fe-fc80-4399-800b-76fb8cf83b22 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e018550>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.783491 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-869e70fe-fc80-4399-800b-76fb8cf83b22 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.168117 Jun 16 17:43:57.790982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Jun 16 17:43:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:57.797585 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ac349e34-93c8-40de-9be7-e9934c5ac246 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e00f430>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.988604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ac349e34-93c8-40de-9be7-e9934c5ac246 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195882 Jun 16 17:43:57.998433 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1187 bytes} [Thu Jun 16 17:43:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:58.002546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8f505b33-5306-43a6-874d-ce8079c3ae85 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] Calling method '.version_select at 0x7f288e01f1f0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:58.192245 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8f505b33-5306-43a6-874d-ce8079c3ae85 tempest-VolumesTestJSON-2051702202 tempest-VolumesTestJSON-2051702202-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.193848 Jun 16 17:43:58.194065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Jun 16 17:43:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:00.817727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-157d7adc-2e62-4979-9988-b9ed49d85ea2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: .version_select at 0x7f288e0595e0>, body: {"keypair": {"name": "tempest-keypair-1730218439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5ch8uypjyppY9cu2Uo/kPQv/lO0+jwibhgVL2prbIBbW83Up6uIrpxd+3AwyedPsqgtKN30Hzi4suGhMLJyIoKB2d8cl7aerS8R528mqQaio3BZARUD1j4/MQVQUZBQ=="}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:00.933188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-157d7adc-2e62-4979-9988-b9ed49d85ea2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:00.956061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-157d7adc-2e62-4979-9988-b9ed49d85ea2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for user 813dd0cf7e1d4724b903b358aaac1ea7 and project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:01.086335 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-157d7adc-2e62-4979-9988-b9ed49d85ea2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.551021 Jun 16 17:44:01.092249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 6/12] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:44:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:05.708035 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-232568080", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "networks": [{"uuid": "1313bc49-f1e5-489d-9df6-eb69b7902eb6"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:06.009744 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] validate_networks() for [('1313bc49-f1e5-489d-9df6-eb69b7902eb6', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:44:06.450380 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9cda4268-deed-4ab7-9a35-d38aaf805974 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: .version_select at 0x7f288df77430>, body: {"keypair": {"name": "tempest-keypair-539835213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1h+XyLionjpTcC18iNjdIpIilNarq/VWUZFT6uDKU1PoJii/9Wk9pKb5Gqyx4WmdFB/qLHlGkKGyj63kOW6Qk2yBfAWREEoXjXStechzPJwfkp82teBjwIUGbV9o6k7w=="}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:06.497238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-9cda4268-deed-4ab7-9a35-d38aaf805974 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:06.509465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-9cda4268-deed-4ab7-9a35-d38aaf805974 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:06.568123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9cda4268-deed-4ab7-9a35-d38aaf805974 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.601404 Jun 16 17:44:06.569459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 7/13] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:44:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:09.673177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-94750d3d-1725-4909-820d-5b38a96b0a24 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'create', calling method: .version_select at 0x7f288dfab8b0>, body: {"keypair": {"name": "tempest-keypair-978873875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/w+qSFVkk0kovLbJOtcpPeCRKBoNwEJ2C2a6zxAQU8rtBGzvEH27BOsg25EwSsuWdVfUZeyIS8p3FqcGoK6AoAgkUWI+J4FMB5X1IE4SNxBWTJEcm8PmTIkgDL8CRPNQ=="}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:09.707679 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-94750d3d-1725-4909-820d-5b38a96b0a24 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:09.734047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-94750d3d-1725-4909-820d-5b38a96b0a24 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for user 7b078c6bfca04de790e7b2e45739033e and project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:09.798132 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-94750d3d-1725-4909-820d-5b38a96b0a24 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.538895 Jun 16 17:44:09.798932 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 8/14] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Jun 16 17:44:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 541 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 17:44:09.808934 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-521616477", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "003c932a-79ef-4308-9a89-4be5c9bc35e8"}], "security_groups": [{"name": "tempest-securitygroup--414679490"}], "key_name": "tempest-keypair-1730218439", "user_data": "}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:09.982811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:44:09.983908 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:44:09.984730 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:44:09.985416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:44:09.986008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:44:10.027523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:10.029240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:10.031674 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:10.032408 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:10.077939 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Getting quotas for project 375c9f75db854f22a560c9f6408f16b5. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:10.087741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Getting quotas for user e577b2f2f18a4be397b6ea6e7f1ba0ad and project 375c9f75db854f22a560c9f6408f16b5. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:10.105757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:44:10.109378 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:44:10.321300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] validate_networks() for [('003c932a-79ef-4308-9a89-4be5c9bc35e8', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:44:10.338914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ace67f2c-477f-4390-a893-0b4a93de1fdc tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.875683 Jun 16 17:44:10.339968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 7/15] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:44:10.869944 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-285913364", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:11.004426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] validate_networks() for [('26d6efeb-cb64-4564-b4f9-c2eead44a479', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:44:13.444814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:44:13.445458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:44:13.445959 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:44:13.446383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:44:13.446948 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:44:13.466945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:13.467407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:13.477584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:13.478274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:13.593923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:13.612674 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for user 813dd0cf7e1d4724b903b358aaac1ea7 and project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:13.646838 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:44:13.656742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:44:13.718645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:44:13.719106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:44:13.719539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:44:13.719957 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:44:13.720395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:44:13.731091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:13.731549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:13.732357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:13.732828 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:13.816543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:13.821269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for user 268c5947a265492bb7a8f181f9f5c504 and project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:13.848954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-449516b3-371d-4008-98c5-390edf8a8cbd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.048769 Jun 16 17:44:13.850205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 9/16] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:44:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 4051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:44:13.855466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:13.860692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:13.873187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:44:13.891789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:44:13.929539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:13.935254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:13.939323 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:13.939821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:14.116623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-96c7011b-d34a-4d56-8e50-fa3fdc8a8fdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.771262 Jun 16 17:44:14.147030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 8/17] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:44:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:44:14.173415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1649575782", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "639fb565-e4f0-4aac-b614-b6cb5489e420"}], "security_groups": [{"name": "tempest-securitygroup--2142296575"}], "key_name": "tempest-keypair-978873875", "user_data": "}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:14.566764 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] validate_networks() for [('639fb565-e4f0-4aac-b614-b6cb5489e420', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:44:14.716818 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:14.761403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-838adc41-470f-40f2-ab62-ea60195f818d tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1266 microversion: 2.1 time: 0.909814 Jun 16 17:44:14.771850 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:13 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1266 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:14.789707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-838ebe38-e26e-42c4-adfe-9169ff87e7f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:14.801337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-838ebe38-e26e-42c4-adfe-9169ff87e7f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:15.116421 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-838ebe38-e26e-42c4-adfe-9169ff87e7f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:15.137877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-838ebe38-e26e-42c4-adfe-9169ff87e7f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1237 microversion: 2.1 time: 0.364805 Jun 16 17:44:15.154846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:14 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1237 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:15.173015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-009c6af5-bc22-4b29-9524-e58118fde090 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:15.175092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-009c6af5-bc22-4b29-9524-e58118fde090 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:15.453547 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-009c6af5-bc22-4b29-9524-e58118fde090 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:15.463664 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-009c6af5-bc22-4b29-9524-e58118fde090 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1221 microversion: 2.1 time: 0.302737 Jun 16 17:44:15.467266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:15 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1221 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:15.484613 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2118854281", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73e06f90-3f8b-46da-a984-8f18b234443c"}], "security_groups": [{"name": "tempest-securitygroup--551213334"}], "key_name": "tempest-keypair-539835213", "user_data": "}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:15.771763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] validate_networks() for [('73e06f90-3f8b-46da-a984-8f18b234443c', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:44:16.387224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:44:16.389030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:44:16.390370 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:44:16.391930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:44:16.392620 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:44:16.412555 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:16.413251 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:16.414282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:16.415568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:16.440885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:16.445725 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for user 7b078c6bfca04de790e7b2e45739033e and project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:16.463698 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:44:16.466786 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:44:16.561696 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9308d3b0-eb3f-42fb-aa84-8a7755aa6c50 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.411405 Jun 16 17:44:16.564135 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 9/21] 10.222.0.42 () {62 vars in 1187 bytes} [Thu Jun 16 17:44:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 17:44:16.575194 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:16.576168 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:16.603453 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:16.603580 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:16.605624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:16.605624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:16.823483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:44:16.823964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:16.824851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:44:16.825767 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:44:16.826979 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:44:16.828621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:44:16.869670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-694a8ac0-0573-4ffd-a095-449bb23c5dc9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1272 microversion: 2.1 time: 0.303190 Jun 16 17:44:16.871328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:16.873519 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:16.875895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:16.876869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:16.877192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 10/22] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:16 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:16.905311 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1193326526", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:16.919976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:16.940995 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:16.998002 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:44:17.006581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:44:17.046380 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] validate_networks() for [('26d6efeb-cb64-4564-b4f9-c2eead44a479', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:44:17.107977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ff6d2fd1-df40-45dc-99fe-5ed70399a49a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.637577 Jun 16 17:44:17.109856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 13/23] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:44:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:44:17.117481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:17.118431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:17.126214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:17.127270 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:17.128318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:17.128990 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:17.235681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:17.252938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-063d843f-9e26-4ad3-a447-b8d319c76d1c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1241 microversion: 2.1 time: 0.137461 Jun 16 17:44:17.265685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 14/24] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:17 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:17.279083 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e4c8ce96-28fa-4b4e-b221-ed39eeeab259 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:17.281468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e4c8ce96-28fa-4b4e-b221-ed39eeeab259 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:17.417856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e4c8ce96-28fa-4b4e-b221-ed39eeeab259 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:17.432558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e4c8ce96-28fa-4b4e-b221-ed39eeeab259 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:17.456210 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e4c8ce96-28fa-4b4e-b221-ed39eeeab259 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:17.457795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e4c8ce96-28fa-4b4e-b221-ed39eeeab259 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1281 microversion: 2.20 time: 0.189247 Jun 16 17:44:17.461796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 15/25] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:17 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:17.476460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b94f7670-0af8-46a1-a0cd-f8cd5cab107e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:17.480934 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b94f7670-0af8-46a1-a0cd-f8cd5cab107e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:17.699655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b94f7670-0af8-46a1-a0cd-f8cd5cab107e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:17.732873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b94f7670-0af8-46a1-a0cd-f8cd5cab107e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1241 microversion: 2.1 time: 0.254091 Jun 16 17:44:17.734373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 16/26] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:17 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1241 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:17.894820 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:17.896873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:17.903687 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:17.904877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:17.911595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:17.912274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.256365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:18.269395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9f21b5c6-4fbb-451d-9d60-f3380acf0fe3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1272 microversion: 2.1 time: 0.381094 Jun 16 17:44:18.270587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:17 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:18.288099 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:18.290174 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:18.313238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.313973 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.317062 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.324902 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.488986 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:18.501731 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f0f27851-1987-4942-9c3e-755bd2ff6e35 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1233 microversion: 2.1 time: 0.224584 Jun 16 17:44:18.504092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 18/28] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:18 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1233 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:18.518648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:18.519588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:18.535467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.536299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.539366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.542264 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.774891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:18.793720 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:18.799727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:18.800988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6c33a2d4-eda3-48c6-ba5e-391d9eb4f0c8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1333 microversion: 2.20 time: 0.295466 Jun 16 17:44:18.817790 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 19/29] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:18 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1333 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:18.837885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:44:18.838403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:18.838678 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:18.838982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:44:18.839474 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:44:18.839899 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:44:18.840324 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:44:18.857917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.858402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.859404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.865670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:18.867763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.870524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.876459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.880067 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:18.884053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:18.939799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:44:18.963784 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for user 268c5947a265492bb7a8f181f9f5c504 and project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:44:19.028802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:44:19.038598 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:44:19.194343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:19.214503 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-973aaa2f-5150-4801-a23f-8e99801b9284 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.336180 Jun 16 17:44:19.222323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 11/30] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:44:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:44:19.236988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a1c1cd2b-ea51-47eb-bd7e-e4f0f84c555d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.415037 Jun 16 17:44:19.240043 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6b13cbd7-43d1-4325-8b97-97e8a66f1ec0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:19.245221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6b13cbd7-43d1-4325-8b97-97e8a66f1ec0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:19.247857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 20/31] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:18 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:19.287889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:19.289154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:19.303095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:19.309355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:19.319541 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:19.320298 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:19.527558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6b13cbd7-43d1-4325-8b97-97e8a66f1ec0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:19.565846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6b13cbd7-43d1-4325-8b97-97e8a66f1ec0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1222 microversion: 2.1 time: 0.336243 Jun 16 17:44:19.567872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 12/32] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:19 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1222 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:19.580904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:19.591423 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:19.637208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:19.637208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:19.637208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:19.637208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:19.996338 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.024796 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-706bf91d-03fd-4a62-b0c9-561f0f3a6ecb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.457203 Jun 16 17:44:20.025537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 13/33] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:19 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:20.038735 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:20.039916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:20.054613 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:20.068000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:20.071406 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:20.072066 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:20.098161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.106141 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bdb6813e-b39d-4cfd-ab76-d4ad267bb3f7 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.822438 Jun 16 17:44:20.106733 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 21/34] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:19 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:20.252714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.268716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:20.269406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:20.295478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.297877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:20.299613 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:20.302191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.303856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:20.305214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:20.308878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e0cfb966-8125-448a-aeab-9ea204b6c41b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1333 microversion: 2.20 time: 0.279896 Jun 16 17:44:20.312221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 14/35] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:20 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1333 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:20.456628 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.484326 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0df5e34c-753a-4c39-b8c9-2e5e0a92ecc7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.230130 Jun 16 17:44:20.487651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 22/36] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:20 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:20.585926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:20.586773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:20.595861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:20.599963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:20.602632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:20.603140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:20.693504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:20.704658 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e60dec40-3013-43d0-b824-58d31d61893d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.123143 Jun 16 17:44:20.706105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 15/37] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:20 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:21.043126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:21.043961 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:21.062319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.063251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.065109 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.069583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.126533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:21.127776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:21.153207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.154705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.156647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.157289 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.264296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.274148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-207a3352-1e10-4663-b038-0dcb6356c82f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.233920 Jun 16 17:44:21.276137 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 23/38] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:21 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:21.332191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:21.333095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:21.354606 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.355074 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.355880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.356327 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.496290 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.518883 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.521975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.526082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c977b21e-1607-4f08-9555-b6a37db6bd36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.199813 Jun 16 17:44:21.528672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 24/39] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:21 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:21.544443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:21.562498 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:21.580391 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.581003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.584473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.585183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.668429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.680043 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c458c79c-4062-47b2-9681-7fb034a4a76e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.557394 Jun 16 17:44:21.688539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 16/40] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:21 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:21.723655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:21.724278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:21.733152 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.746978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4fdeda12-b6b9-4221-910d-8da24fdbca87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.215318 Jun 16 17:44:21.749569 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 25/41] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:21 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:21.750845 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.751459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.752417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:21.752996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:21.836422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:21.850918 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4dc7aca6-dad3-4226-b8be-882df3e20512 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.131849 Jun 16 17:44:21.861849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 17/42] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:21 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:22.295274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:22.296580 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:22.305095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.305554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.306342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.306786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.390692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:22.398693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6a1b6786-3423-426b-a133-fed1603cbe44 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.108552 Jun 16 17:44:22.399338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 26/43] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:22 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:22.546576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:22.547328 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:22.553828 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.554341 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.555192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.555701 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.636339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:22.648333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:22.652036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:22.653268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-39fd0dc8-044f-4fbe-92af-2c0e8f639240 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.111643 Jun 16 17:44:22.657204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 18/44] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:22 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:44:22.706400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:22.707386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:22.714749 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.715707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.716900 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.718080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.765180 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:22.765904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:22.778649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.779069 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.780719 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.783271 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.902923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:22.908033 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:22.912626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0b78bdc6-7c4d-4ca8-9011-e03fa3441fcc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.151330 Jun 16 17:44:22.913602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 19/45] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:22 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:22.918277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:22.919295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:22.926768 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.926894 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.927926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:22.928562 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:22.930584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5a4eef11-17f9-40f2-b7ea-30903fb1a211 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.234467 Jun 16 17:44:22.931648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 27/46] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:22 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:23.016078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:23.037519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-23dee384-abbc-497a-8f5e-9e2439896293 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.121197 Jun 16 17:44:23.049363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 20/47] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:22 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:23.424896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:23.427456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:23.442252 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.443031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.459031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.459848 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.594523 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:23.602487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1d7fa068-073f-41a7-8edc-449446631d60 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.191181 Jun 16 17:44:23.621482 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 28/48] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:23 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:23.673701 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:23.674373 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:23.683327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.684428 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.695980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.696363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.851021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:23.861877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:23.863592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:23.864824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-673859e1-e05c-4a61-895f-58e330062be6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.196029 Jun 16 17:44:23.884456 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 21/49] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:23 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:23.930642 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:23.931443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:23.953787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:23.954234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.954878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:23.956819 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.961109 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.963043 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.972212 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.973184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:23.974280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:23.974937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:24.286989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:24.299981 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3ccfcd5f-d195-4387-be09-3c0aed2a66ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.373594 Jun 16 17:44:24.320193 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 29/50] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:23 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:24.325475 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:24.328506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:24.337978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:24.338433 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:24.339219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:24.339658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:24.363178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:24.386675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b418c456-e587-4409-a435-db96c8d898b6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.442114 Jun 16 17:44:24.387843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 22/51] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:23 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:24.460815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:24.465236 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:24.470554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-970568c7-56e8-4421-a5bb-b644b7f1cb73 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.148876 Jun 16 17:44:24.480204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 30/52] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:24 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:24.628757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:24.629395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:24.638308 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:24.639739 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:24.640747 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:24.641352 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:24.715434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:24.724042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d3f5f363-363e-4ff5-a25e-3bf2bb884cfc tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.099471 Jun 16 17:44:24.724889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 23/53] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:24 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:24.885375 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:24.886357 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:24.895436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:24.895889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:24.896764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:24.897361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.038125 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.048158 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.050039 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.051412 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4b5521f6-16d0-430f-853e-d0858bb088d7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.170213 Jun 16 17:44:25.052654 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 31/54] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:24 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:25.319619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:25.320217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:25.328806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.329479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.330360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.330801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.405413 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:25.406552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:25.428015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.429649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.430651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.433528 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.453057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.469650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8409adb2-a42e-4103-a1d5-fe5bc922bfcb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.153009 Jun 16 17:44:25.471900 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 24/55] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:25 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:25.492792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:25.494332 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:25.509543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.516625 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.517668 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.518239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.620652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.638029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-71d3f3fb-691e-4588-ad01-8bbc1a6c187d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.150695 Jun 16 17:44:25.639925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 25/56] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:25 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:25.742593 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:25.744216 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:25.745772 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.747615 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:25.757264 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6597f30c-6dad-4c90-95cd-17164f63cefd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.356814 Jun 16 17:44:25.757956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.758676 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 32/57] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:25 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:25.758814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.759557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:25.759998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:25.848979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:25.857984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7b66f555-6089-48d6-8474-0c8005219367 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.119388 Jun 16 17:44:25.859544 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 26/58] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:25 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:26.081215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.082731 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.090572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.091329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.093081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.093801 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.195865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:26.205527 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:26.207572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:26.208915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9bbbb47c-b640-4e94-a50f-e548bc235068 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.135510 Jun 16 17:44:26.209468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 33/59] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:26 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:26.487892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.488561 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.495080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.495532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.496307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.502267 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.512295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:26.617831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:26.640530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f2dd0e73-4f50-4306-9e7d-3faace6c0647 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.150017 Jun 16 17:44:26.650184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 27/60] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:26 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:26.655914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.656807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.666258 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.680839 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.681812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.682472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.777807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.778431 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.793252 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.793716 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.795758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.797446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.813379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:26.833552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-25ca21f5-a5e7-44cf-8a69-359198db8706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.182230 Jun 16 17:44:26.843286 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 34/61] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:26 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:26.877587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.878574 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.894845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.896793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.898586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.899307 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.904024 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=4 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:27.050599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.060975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a17a328f-9399-4d5d-aaa1-a7f11019eb6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.189196 Jun 16 17:44:27.063028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 35/62] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:26 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:27.164676 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.172890 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b9932e8e-9d02-4a40-9eb6-c8003ebc7a5b tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.399266 Jun 16 17:44:27.173475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 28/63] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:26 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:27.243693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:27.244416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:27.252857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:27.253422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.256358 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:27.256358 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.332580 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.350013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.351980 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.353589 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-38c3fb59-9c52-4625-9c52-410fe42189b2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.127800 Jun 16 17:44:27.354968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 36/64] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:27 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:27.663482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:27.664793 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:27.675793 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:27.676740 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.677884 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:27.678826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.757447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.766280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-930ef406-c857-4687-9276-2a53e2cf844d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.111440 Jun 16 17:44:27.766971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 29/65] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:27 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:27.850506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:27.857318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:27.868857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=32 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:27.875553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:27.876288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.880245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:27.881014 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.980591 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.014773 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a16299f6-bd62-489f-b465-f21d72d68971 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.159528 Jun 16 17:44:28.024363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 37/66] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:27 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:28.080914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:28.082787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:28.089794 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.090659 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.091252 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.091683 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.174810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.182385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-04a0d5c7-420a-4932-890f-c73f68041b8a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.107096 Jun 16 17:44:28.182969 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 30/67] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:28 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:28.197314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:28.198214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:28.204780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.205229 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.206052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.206655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.374076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:28.374912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:28.376177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.385777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.386524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.387550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.388223 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.390161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e2384f73-62a9-4d1e-8d4d-f0aee3958709 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.192916 Jun 16 17:44:28.400165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 38/68] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:28 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:28.493170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.505082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.506914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.508839 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c8e8fe56-8a13-4657-ad67-af649e0a421c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.138616 Jun 16 17:44:28.510184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 31/69] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:28 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:28.783166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:28.783777 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:28.790110 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.790557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.791508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.792096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.866556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.876083 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1e0e81b5-e27c-4e65-a0dd-c2d8d8f448c9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.096683 Jun 16 17:44:28.876790 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 39/70] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:28 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:29.032295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:29.032952 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:29.034821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=8 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:29.040477 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.041240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.042194 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.042809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.132525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:29.143292 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-eddd73fb-d2f5-4efc-8982-e8d57cc9261d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.115163 Jun 16 17:44:29.144033 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 32/71] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:29 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:29.201702 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:29.202994 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:29.211095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.211998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.213205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.213868 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.316135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:29.322736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c895ef14-081e-46d6-b417-7484f269ddfb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.127154 Jun 16 17:44:29.323361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 40/72] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:29 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:29.410552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:29.411846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:29.420063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.421923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.422776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.423396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.528667 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:29.530128 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:29.536893 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.537163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=26 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:29.537423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.538220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.538658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.588270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:29.608510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c0cf335b-d324-42f7-9e3d-74b62e1edaa2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.201712 Jun 16 17:44:29.618360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 33/73] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:29 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:29.653441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:29.667052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:29.668922 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:29.670046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8412692b-460d-4b1a-a29f-0a0d0824bc44 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.145388 Jun 16 17:44:29.671529 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 41/74] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:29 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:29.903585 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:29.904213 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:29.913861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.914314 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.915092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.915558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.011699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.022080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f23dcb16-41b3-40e0-9e6a-a7ec857cc9d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.122390 Jun 16 17:44:30.022915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 34/75] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:29 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:30.159781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:30.161427 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:30.169289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.169919 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.171147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.171780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.235713 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.246324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6e5d5bb3-5bd6-4e3b-9329-1b6952597314 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1226 microversion: 2.1 time: 0.090620 Jun 16 17:44:30.246908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 42/76] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:30 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:30.340617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:30.341847 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:30.350775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.351578 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.352634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.353329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.425682 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.433479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-695d090e-abfd-44ac-98ca-e16425c8c167 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1289 microversion: 2.1 time: 0.096941 Jun 16 17:44:30.443437 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 35/77] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:30 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:30.625954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:30.626620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:30.632552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.633000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.634007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.634444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.689476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:30.690112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:30.696170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.696743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.697569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:30.698071 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:30.774515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.783004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.784551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.785659 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-aa116644-c4e3-4221-9153-4903878f9f6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1341 microversion: 2.20 time: 0.100776 Jun 16 17:44:30.786223 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 36/78] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:30 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1341 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:44:30.796181 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:30.803615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d13f84a1-f999-4621-a54e-a0f2e68f30b0 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.181515 Jun 16 17:44:30.804180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 43/79] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:30 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:31.046654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:31.048877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:31.069723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.070438 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.071748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.072425 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.281006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:31.286480 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:31.329422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.333644 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.337962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.340621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.405010 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:31.417067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3380d398-73da-441d-b840-8cd666f294ba tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1293 microversion: 2.1 time: 0.379395 Jun 16 17:44:31.419182 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 37/80] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:31 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1293 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:31.451104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:31.453322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:31.460511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.461169 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.462517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.463641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.470558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:31.478056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e3eafb91-afc3-41f7-ab3e-4444e953ac19 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1218 microversion: 2.1 time: 0.207839 Jun 16 17:44:31.478570 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 44/81] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:31 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:31.542235 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:31.557500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-47d43907-8a15-4f7d-8eef-7f4a95157ebd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1307 microversion: 2.1 time: 0.105126 Jun 16 17:44:31.557500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 38/82] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:31 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:31.804777 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:31.805723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:31.823307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:31.824442 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:31.838643 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.842957 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.844319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.845423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.848994 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.849470 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:31.850846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:31.851293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.068775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:32.077427 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:32.079224 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:32.080344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0d700213-57a9-4998-8f3a-76c60ca92a97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1339 microversion: 2.20 time: 0.280534 Jun 16 17:44:32.081118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 45/83] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:31 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:32.311527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:32.330827 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-743ee54a-83b5-4bf4-935e-47a2ac53a764 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.513046 Jun 16 17:44:32.332199 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 39/84] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:31 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:32.435525 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:32.444112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:32.456659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.457261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.458454 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.459053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.495191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:32.496465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:32.505383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.506111 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.522848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.530294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.020098 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.033684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b98f3a57-2edf-413c-951b-a6ea306cd535 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1301 microversion: 2.1 time: 0.602352 Jun 16 17:44:33.034503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 46/85] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:32 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1301 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:33.050060 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:33.050693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:33.063987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:33.064481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.065278 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:33.077111 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.078840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.097482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-66772d73-4154-4ec3-9c57-dd2c8659359b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1282 microversion: 2.1 time: 0.606260 Jun 16 17:44:33.109184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 40/86] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:32 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1282 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:33.114039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:33.114666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:33.126665 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:33.127127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.127915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:33.128354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.139096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:33.487059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.499256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-396446e4-97c8-45dc-bce5-8c7b799b147f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1295 microversion: 2.1 time: 0.463388 Jun 16 17:44:33.500229 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 47/87] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:33 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1295 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:33.522256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:33.523748 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:33.532889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:33.534024 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.534999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:33.549029 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.572870 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.586628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.590703 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.594460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4057a6dd-7bf3-475b-905a-7a935579316c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1339 microversion: 2.20 time: 0.484176 Jun 16 17:44:33.595053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 41/88] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:33 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1339 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:34.053740 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:34.054787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:34.066034 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.066846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.068479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.069368 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.445981 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:34.458476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d61f15b7-2e62-4996-8fbf-275e9e5c59dc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1299 microversion: 2.1 time: 0.410983 Jun 16 17:44:34.459391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 42/89] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:34 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1299 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:34.463788 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:34.464471 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:34.488209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.488924 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.489470 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.490056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.497411 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:34.516146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f0fc9035-79a1-4339-8ee2-8f2d6f6b3329 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.997827 Jun 16 17:44:34.521362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 48/90] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:33 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:34.534652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:34.535519 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:34.549148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.549857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.550786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.552435 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.762868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:34.769457 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:34.781684 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cde2a9fa-1566-4a68-a4a0-56ba6421f0db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1280 microversion: 2.1 time: 0.319154 Jun 16 17:44:34.783288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 43/91] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:34 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:34.791408 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:34.792965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:34.808312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.809116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.810360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.811618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.023715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:35.034246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:35.045563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:35.047169 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-28bd7039-c2e0-4ff1-8727-4199889d0087 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1339 microversion: 2.20 time: 0.262548 Jun 16 17:44:35.047959 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 44/92] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:34 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:35.156513 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-b131c41c-b1b7-4732-8002-4a597f1e7dbc req-b7785f02-9212-497e-83b9-ac2ea65e7b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d948b628-6612-4dc0-adb7-2ba4bffc810c", "tag": "6b353818-db5f-43c7-9236-5239f9413599"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:35.177510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b131c41c-b1b7-4732-8002-4a597f1e7dbc req-b7785f02-9212-497e-83b9-ac2ea65e7b28 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.178131 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b131c41c-b1b7-4732-8002-4a597f1e7dbc req-b7785f02-9212-497e-83b9-ac2ea65e7b28 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.208412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-b131c41c-b1b7-4732-8002-4a597f1e7dbc req-b7785f02-9212-497e-83b9-ac2ea65e7b28 service nova] Creating event network-changed:6b353818-db5f-43c7-9236-5239f9413599 for instance d948b628-6612-4dc0-adb7-2ba4bffc810c on hv-cinder-83754 Jun 16 17:44:35.208939 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b131c41c-b1b7-4732-8002-4a597f1e7dbc req-b7785f02-9212-497e-83b9-ac2ea65e7b28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124158) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 17:44:35.210234 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.210653 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.211329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.211759 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.222293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.compute.rpcapi [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 17:44:35.223190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] Releasing lock "compute-rpcapi-router" {{(pid=124158) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 17:44:35.256909 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-059dda14-f9f3-4cf9-b7c6-00208c198c6f None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207466 Jun 16 17:44:35.257570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 45/93] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:35.495656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-a09e07c8-7f51-415d-8ba6-9c3573bb5ddf req-47068973-2bec-45f9-937d-8d8861a87252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f41ab89-366a-4e5a-bc54-8033b67ed35f", "tag": "02aba641-872c-491e-ba26-a9743d7f14f4"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:35.505569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-a09e07c8-7f51-415d-8ba6-9c3573bb5ddf req-47068973-2bec-45f9-937d-8d8861a87252 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.506089 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-a09e07c8-7f51-415d-8ba6-9c3573bb5ddf req-47068973-2bec-45f9-937d-8d8861a87252 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.519504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-a09e07c8-7f51-415d-8ba6-9c3573bb5ddf req-47068973-2bec-45f9-937d-8d8861a87252 service nova] Creating event network-changed:02aba641-872c-491e-ba26-a9743d7f14f4 for instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f on hv-cinder-83754 Jun 16 17:44:35.525660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-a09e07c8-7f51-415d-8ba6-9c3573bb5ddf req-47068973-2bec-45f9-937d-8d8861a87252 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125419 Jun 16 17:44:35.526633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 46/94] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:35.534372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:35.535464 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:35.543848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.544298 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.546590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.547308 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.662393 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:35.677618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a0069d75-b300-4ac8-a09d-5bf828cdf6d8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 1.154888 Jun 16 17:44:35.679695 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 49/95] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:34 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:35.694220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:35.696450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:35.712546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.718240 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.727576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.728740 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.812332 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:35.821775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7b63bfb8-1b0f-4110-b986-ace6bc2cc20b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1299 microversion: 2.1 time: 0.293513 Jun 16 17:44:35.827006 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 47/96] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:35 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1299 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:35.842579 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:35.843590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:35.858029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.868884 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.869923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.870522 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.207993 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:36.224432 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a3fec58c-a9d4-4244-ace2-2cbaa6fd0aae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1280 microversion: 2.1 time: 0.396008 Jun 16 17:44:36.226131 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 48/97] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:35 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:36.232858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:36.233875 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:36.241869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.242643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.243534 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.244108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.570730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:36.586178 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-df36a909-585a-476e-936a-91dca09e76fe tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.904955 Jun 16 17:44:36.587376 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 50/98] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:35 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:36.699636 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:36.705125 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:36.714646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.715289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.716254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.716716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.767680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:36.782010 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:36.783832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:36.785473 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b168acb1-9763-499c-99b5-aee0954a7904 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.557513 Jun 16 17:44:36.786570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 49/99] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:36 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:36.843316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:36.845263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:36.851860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.852304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.853095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.853532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.090422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:37.099434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-178a18a3-aba7-40de-9b54-65462f68e77a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1299 microversion: 2.1 time: 0.260211 Jun 16 17:44:37.100342 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 50/100] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:36 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:37.243106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:37.243737 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:37.250429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.251728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.252508 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.252931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.523456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:37.536834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cc622199-d5f8-4268-a076-e43a545cb066 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.842825 Jun 16 17:44:37.546875 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 51/101] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:36 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:37.557454 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-031674fb-cdf6-49f4-a96e-abf939d2a122 req-36a72ab3-08f3-4d65-b2a8-d9fde46e8a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6228596e-39a4-457c-bdad-6fb60dc046f6", "tag": "4b250132-04cb-44f4-9f14-4f5e43091658"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:37.584449 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-031674fb-cdf6-49f4-a96e-abf939d2a122 req-36a72ab3-08f3-4d65-b2a8-d9fde46e8a54 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.584891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-031674fb-cdf6-49f4-a96e-abf939d2a122 req-36a72ab3-08f3-4d65-b2a8-d9fde46e8a54 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.609881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-031674fb-cdf6-49f4-a96e-abf939d2a122 req-36a72ab3-08f3-4d65-b2a8-d9fde46e8a54 service nova] Creating event network-changed:4b250132-04cb-44f4-9f14-4f5e43091658 for instance 6228596e-39a4-457c-bdad-6fb60dc046f6 on hv-cinder-83754 Jun 16 17:44:37.610504 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-031674fb-cdf6-49f4-a96e-abf939d2a122 req-36a72ab3-08f3-4d65-b2a8-d9fde46e8a54 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124157) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 17:44:37.611907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.612474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.613301 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.613732 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.622882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.compute.rpcapi [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 17:44:37.624295 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] Releasing lock "compute-rpcapi-router" {{(pid=124157) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 17:44:37.657131 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c4ad51c8-3ecc-4604-b482-14b3481131a5 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113934 Jun 16 17:44:37.658904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 52/102] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:37.664989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:37.666112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:37.693906 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.694491 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.695464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.695905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.913528 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:37.926252 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-36f0de22-a473-42ea-b35f-837e28a356cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.687549 Jun 16 17:44:37.936663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 51/103] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:37 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:37.956217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:37.957053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:37.963586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.964864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:37.966625 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:37.968567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:38.420914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:38.458134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3e443226-00e7-4864-a368-0d2f75bfa3fa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.792421 Jun 16 17:44:38.460124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 53/104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:37 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:38.476445 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:38.478027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:38.493374 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:38.493832 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:38.494651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:38.495085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:38.835802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:38.850104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:38.858033 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:38.861923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-532e8786-1a5c-4d8d-8850-abc3722bfdd0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.911422 Jun 16 17:44:38.864103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 52/105] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:37 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:38.878206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:38.879080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:38.896854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:38.899516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:38.900530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:38.903720 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:38.962344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:38.973375 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dc60dbdf-f474-4828-8f6d-f6b2350b6058 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.511714 Jun 16 17:44:38.974488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 54/106] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:38 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:38.980753 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:38.981683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:38.991459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:38.992443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:38.994241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:38.994950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:39.455246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:39.484483 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6526353e-6d8b-4113-971e-9c9f9e81e0f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.616287 Jun 16 17:44:39.485890 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:38 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:39.493453 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:39.496586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:39.507951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:39.508833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:39.510081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:39.511558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:40.084498 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:40.096285 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1ab96d21-e805-4237-b995-12faa6e09278 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 1.120481 Jun 16 17:44:40.109403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:38 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:40.116395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-70bdcc10-fe3f-4872-8dae-71767107a101 req-005b165b-e2e0-4182-bb38-845770c64172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:40.131557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-70bdcc10-fe3f-4872-8dae-71767107a101 req-005b165b-e2e0-4182-bb38-845770c64172 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:40.132658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-70bdcc10-fe3f-4872-8dae-71767107a101 req-005b165b-e2e0-4182-bb38-845770c64172 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:40.148576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-70bdcc10-fe3f-4872-8dae-71767107a101 req-005b165b-e2e0-4182-bb38-845770c64172 service nova] Creating event network-changed:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:44:40.159420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-70bdcc10-fe3f-4872-8dae-71767107a101 req-005b165b-e2e0-4182-bb38-845770c64172 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045325 Jun 16 17:44:40.160871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 56/109] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:40.177100 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:40.179836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:40.194433 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:40.194774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:40.195592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:40.195987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:40.975584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:40.989542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-80e015e4-87ac-4655-b0bc-43a02277d739 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 1.502413 Jun 16 17:44:40.990420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 54/110] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:39 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:40.995644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:40.996399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:41.004383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:41.005551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:41.006605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:41.007823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:41.109894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:41.121806 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:41.127806 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:41.132185 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-aa601d62-087e-4dd1-8538-cb22d477743a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.968749 Jun 16 17:44:41.148415 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 57/111] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:40 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:41.154421 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:41.155145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:41.175381 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:41.175895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:41.183518 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:41.184825 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:41.716129 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:41.726359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-63c7e469-9970-45c1-9446-d13f9d6354fa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.734670 Jun 16 17:44:41.727622 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 55/112] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:40 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:41.733110 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:41.733938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:41.745933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:41.746593 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:41.747593 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:41.748296 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.042309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:42.054402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-59ec75fc-95a9-44eb-9094-30c91867ef79 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.913215 Jun 16 17:44:42.064272 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 58/113] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:41 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:42.330863 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-24ecbfb1-9a58-45e8-8e1e-331d01f391fa req-1e8c5aa2-1105-4826-9de2-3c79d09bb338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d948b628-6612-4dc0-adb7-2ba4bffc810c", "name": "network-vif-plugged", "status": "completed", "tag": "6b353818-db5f-43c7-9236-5239f9413599"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:42.343174 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-24ecbfb1-9a58-45e8-8e1e-331d01f391fa req-1e8c5aa2-1105-4826-9de2-3c79d09bb338 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.343763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-24ecbfb1-9a58-45e8-8e1e-331d01f391fa req-1e8c5aa2-1105-4826-9de2-3c79d09bb338 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.362521 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-24ecbfb1-9a58-45e8-8e1e-331d01f391fa req-1e8c5aa2-1105-4826-9de2-3c79d09bb338 service nova] Creating event network-vif-plugged:6b353818-db5f-43c7-9236-5239f9413599 for instance d948b628-6612-4dc0-adb7-2ba4bffc810c on hv-cinder-83754 Jun 16 17:44:42.376883 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-24ecbfb1-9a58-45e8-8e1e-331d01f391fa req-1e8c5aa2-1105-4826-9de2-3c79d09bb338 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310853 Jun 16 17:44:42.378783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 59/114] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:42.387515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:42.388216 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:42.396936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.397633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.398971 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.399492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.570273 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:42.582429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-18eca1b8-1011-479d-9fcd-e167a179e224 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.853530 Jun 16 17:44:42.583627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:41 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:42.589188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:42.590043 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:42.596718 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.597422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.598351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.598942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.717370 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:42.724814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f47aaad9-04d6-4c99-9e98-d4252205ea75 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.344123 Jun 16 17:44:42.725390 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 60/116] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:42 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:42.729804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-6bbb7cdd-8c2b-4ccd-8476-c6d4ae8d5859 req-adb7c036-4e2b-4521-b1b9-9e8c5965a330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d06d37-30c0-455b-b00a-bc4b9311be03", "tag": "af63ecca-47fb-44c6-a4ae-a10a439cdfda"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:42.738072 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-6bbb7cdd-8c2b-4ccd-8476-c6d4ae8d5859 req-adb7c036-4e2b-4521-b1b9-9e8c5965a330 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.738524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-6bbb7cdd-8c2b-4ccd-8476-c6d4ae8d5859 req-adb7c036-4e2b-4521-b1b9-9e8c5965a330 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.750438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-6bbb7cdd-8c2b-4ccd-8476-c6d4ae8d5859 req-adb7c036-4e2b-4521-b1b9-9e8c5965a330 service nova] Creating event network-changed:af63ecca-47fb-44c6-a4ae-a10a439cdfda for instance 63d06d37-30c0-455b-b00a-bc4b9311be03 on hv-cinder-83754 Jun 16 17:44:42.755248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-6bbb7cdd-8c2b-4ccd-8476-c6d4ae8d5859 req-adb7c036-4e2b-4521-b1b9-9e8c5965a330 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028748 Jun 16 17:44:42.755847 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 61/117] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:42.765991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:42.766795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:42.773947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.774398 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.775543 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:42.775674 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:42.932270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:42.940993 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:42.942576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:42.944402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c9cc9430-9a4a-4fcb-b770-b131e2cf56ce tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.359503 Jun 16 17:44:42.945484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 57/118] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:42 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:43.000027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:43.008384 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5b6b9df0-eae8-4f4b-93de-b66b561cf183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.250236 Jun 16 17:44:43.009191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 62/119] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:42 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:43.070847 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:43.071455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:43.078102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.078553 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.079478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.079919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.226123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:43.234296 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-44ea25c7-a423-455d-960d-30003a286237 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.167088 Jun 16 17:44:43.235075 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 58/120] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:43 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:43.600121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:43.600708 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:43.607133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.607618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.608584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.609022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.742029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:43.742787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:43.749353 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.749808 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.750886 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.751608 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.761492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:43.772736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-acc3417c-f116-4270-a75b-8c150a85921a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.175502 Jun 16 17:44:43.774049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 63/121] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:43 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:43.902534 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:43.910723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-98b8a42b-a4a4-46c7-a940-3a45f7a4670c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.172475 Jun 16 17:44:43.911295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 59/122] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:43 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:43.970842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:43.971609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:43.979259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.979712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:43.980577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:43.981182 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.025926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:44.026540 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:44.032632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.033091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.034309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.035095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.216605 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:44.228096 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:44.231990 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:44.234141 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:44.236024 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-08ffe237-ceb4-46cd-9fd1-0a4588cfbc8f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.271560 Jun 16 17:44:44.236820 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 64/123] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:43 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:44.237152 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-732318d6-9c12-44d6-9e6c-8b970a419773 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.214895 Jun 16 17:44:44.237961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 60/124] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:44 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:44.253468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:44.254069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:44.260467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.260908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.261657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.262084 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.394538 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:44.403225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d1d818c4-86ea-4114-a70f-e6a9d878771f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.153387 Jun 16 17:44:44.403805 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 65/125] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:44 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:44.782269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-dab45e81-92fb-4b2d-88a2-5f37b2962fe0 req-12eb61aa-db18-47fa-9955-c6e097f8b63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1a3f32-7aab-4b92-81cf-74a18b529bff", "tag": "2efcc93f-177c-4f73-9e55-6b3af38cc596"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:44.790580 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:44.791095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-dab45e81-92fb-4b2d-88a2-5f37b2962fe0 req-12eb61aa-db18-47fa-9955-c6e097f8b63a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.791095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-dab45e81-92fb-4b2d-88a2-5f37b2962fe0 req-12eb61aa-db18-47fa-9955-c6e097f8b63a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.792215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:44.799806 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.800503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.801472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.802437 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.806303 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-dab45e81-92fb-4b2d-88a2-5f37b2962fe0 req-12eb61aa-db18-47fa-9955-c6e097f8b63a service nova] Creating event network-changed:2efcc93f-177c-4f73-9e55-6b3af38cc596 for instance dc1a3f32-7aab-4b92-81cf-74a18b529bff on hv-cinder-83754 Jun 16 17:44:44.811952 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-dab45e81-92fb-4b2d-88a2-5f37b2962fe0 req-12eb61aa-db18-47fa-9955-c6e097f8b63a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033840 Jun 16 17:44:44.812755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 61/126] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:44.824438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:44.927547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:44.928240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:44.934424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.934871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.936204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:44.936742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:44.940472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:44.940926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:44.949723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-607c9b3e-7507-46cd-9576-184308bb4bdc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.162850 Jun 16 17:44:44.950563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 66/127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:44 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:45.163656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:45.173423 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c3d0fdc5-fe82-41a5-b78b-74fe1c8f5f94 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.249950 Jun 16 17:44:45.173982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 62/128] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:44 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:45.253841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:45.254460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:45.257464 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:45.258360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:45.260312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:45.260740 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.261201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.261982 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.262424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.267136 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.267645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.268448 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.268887 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.477682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:45.481857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:45.485599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b0558700-aa64-4dc4-8461-421b166a88a1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.235503 Jun 16 17:44:45.486178 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 67/129] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:45 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:45.490667 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:45.491262 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:45.495534 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:45.497471 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:45.499425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.499890 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.500102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6b92c6b7-c3d1-4f7c-aa86-5c0309ae80cb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.246230 Jun 16 17:44:45.500754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.501274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.501727 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 63/130] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:45 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:45.637588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:45.645544 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2d64e390-2e1d-4b2c-b4e1-70fa317b7574 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.158362 Jun 16 17:44:45.646126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 68/131] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:45 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:45.973181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:45.973788 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:45.980366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.982004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:45.988281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:45.989030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:46.196013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:46.196882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:46.209120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:46.210828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:46.212062 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:46.213604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:46.317490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:46.327817 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e29218f8-5d06-4b2b-b18a-8a6f47fe41b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.358444 Jun 16 17:44:46.337942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 64/132] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:45 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:46.396440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-c308482f-0477-44f9-96c6-4fd9ad00ce85 req-51b507f6-cec9-4521-baee-1f15b2a599e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6228596e-39a4-457c-bdad-6fb60dc046f6", "name": "network-vif-plugged", "status": "completed", "tag": "4b250132-04cb-44f4-9f14-4f5e43091658"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:46.412102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-c308482f-0477-44f9-96c6-4fd9ad00ce85 req-51b507f6-cec9-4521-baee-1f15b2a599e0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:46.412864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-c308482f-0477-44f9-96c6-4fd9ad00ce85 req-51b507f6-cec9-4521-baee-1f15b2a599e0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:46.430685 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-c308482f-0477-44f9-96c6-4fd9ad00ce85 req-51b507f6-cec9-4521-baee-1f15b2a599e0 service nova] Creating event network-vif-plugged:4b250132-04cb-44f4-9f14-4f5e43091658 for instance 6228596e-39a4-457c-bdad-6fb60dc046f6 on hv-cinder-83754 Jun 16 17:44:46.437278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-c308482f-0477-44f9-96c6-4fd9ad00ce85 req-51b507f6-cec9-4521-baee-1f15b2a599e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044524 Jun 16 17:44:46.438358 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 65/133] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:46.503721 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:46.504810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:46.519443 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:46.521780 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:46.523494 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:46.524908 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.199705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:47.208463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-abae9343-2e29-44b0-a587-d826849971aa tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 1.018253 Jun 16 17:44:47.209158 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:46 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:47.214984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:47.215877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:47.219628 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:47.224331 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:47.225203 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.226068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:47.226585 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.473169 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:47.483019 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-37bcbff7-632c-457f-8652-d4388a734e3b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.983628 Jun 16 17:44:47.492535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 66/135] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:46 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:47.500479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:47.501100 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:47.507743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:47.508747 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.509569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:47.510062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.543301 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:47.558502 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:47.560795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:47.562114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5a4c10f6-c9ac-40ac-97c7-8354fa4a01b6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.351803 Jun 16 17:44:47.573452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 70/136] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:47 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:47.573452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:47.573452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:47.574620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:47.575147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.576493 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:47.576493 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:47.621564 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:48.004126 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.012879 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-467a4ee1-8c49-45f2-b5ca-f2a9c7e4f5b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.518562 Jun 16 17:44:48.023413 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 67/137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:47 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:48.025176 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.034974 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7abb65b8-43ec-4d68-bab1-e82dfd959fe9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.470518 Jun 16 17:44:48.036681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 71/138] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:47 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:48.226767 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:48.227718 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:48.236475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.237755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.238686 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.239353 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.418908 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.427774 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a5a059bb-2b00-4bb5-b916-0c7c1026ffd3 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.205006 Jun 16 17:44:48.428347 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 68/139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:48 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:48.478030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-1789b932-9e03-4b0d-9c13-80efb6dd229c req-93813891-b982-4802-a8c2-20d22c4a0d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f41ab89-366a-4e5a-bc54-8033b67ed35f", "name": "network-vif-plugged", "status": "completed", "tag": "02aba641-872c-491e-ba26-a9743d7f14f4"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:48.487113 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1789b932-9e03-4b0d-9c13-80efb6dd229c req-93813891-b982-4802-a8c2-20d22c4a0d0e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.487557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1789b932-9e03-4b0d-9c13-80efb6dd229c req-93813891-b982-4802-a8c2-20d22c4a0d0e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.499602 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-1789b932-9e03-4b0d-9c13-80efb6dd229c req-93813891-b982-4802-a8c2-20d22c4a0d0e service nova] Creating event network-vif-plugged:02aba641-872c-491e-ba26-a9743d7f14f4 for instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f on hv-cinder-83754 Jun 16 17:44:48.503738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:48.504609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-1789b932-9e03-4b0d-9c13-80efb6dd229c req-93813891-b982-4802-a8c2-20d22c4a0d0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031315 Jun 16 17:44:48.505770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:48.508460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 72/140] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:48.517057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.518253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.519608 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.520334 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.581256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:48.582135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:48.596536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.596644 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.597338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:48.597771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:48.737831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.746229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-94ed3e2a-94b8-42b1-b410-e31c4d261bef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.249928 Jun 16 17:44:48.747224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 69/141] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:48 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:48.774672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.784871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.786361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:48.787486 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4d21c90d-7d9d-4239-b63d-06971e72d1bb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.210902 Jun 16 17:44:48.788043 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 73/142] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:48 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:44:49.031607 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:49.032132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:49.039519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.039965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.040758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.041191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.055344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:49.056242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:49.065313 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.066188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.067559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.068277 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.283915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:49.291031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:49.292562 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b7a739e7-3ec6-476c-ba5a-a3afc9a7cac2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.265412 Jun 16 17:44:49.294563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:49 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:49.309049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-15f0812e-c804-42c9-90ea-4992b0214b54 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.259157 Jun 16 17:44:49.309651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 74/144] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:49 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:49.454805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:49.460452 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:49.478246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.479588 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.480584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.481364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.634479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:49.645151 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-429d08ab-a544-48f3-a00e-f775d2644f63 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.197948 Jun 16 17:44:49.646823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:49 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:49.764933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:49.765657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:49.775174 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.777572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.778463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.781572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.808811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:49.810907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:49.843456 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.851395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:49.856147 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:49.860621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:50.379476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:50.391643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:50.393757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:50.396066 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5ab173f8-c8cb-44a0-878b-0f3389e29813 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.594656 Jun 16 17:44:50.397047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 72/146] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:49 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:44:50.402036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:50.403253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:50.413465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:50.414270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:50.415363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:50.416008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:50.755242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:50.766010 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7e6876cc-31c8-4238-b27d-f24916d577e6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 1.005352 Jun 16 17:44:50.769989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 75/147] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:49 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:50.777052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:50.778794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:50.787345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:50.787855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:50.788724 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:50.789333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.059139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.071156 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0da88a2b-e77e-4321-8440-eaeb48311888 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1362 microversion: 2.1 time: 0.672693 Jun 16 17:44:51.082161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 73/148] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:50 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:51.087646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-f004ec7e-b8ee-4585-8b8e-e6eab9fb4bd6 req-ecb005ed-dd18-478c-8158-4206781a0a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "name": "network-vif-plugged", "status": "completed", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:51.091506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.098398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-f004ec7e-b8ee-4585-8b8e-e6eab9fb4bd6 req-ecb005ed-dd18-478c-8158-4206781a0a39 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.098903 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-f004ec7e-b8ee-4585-8b8e-e6eab9fb4bd6 req-ecb005ed-dd18-478c-8158-4206781a0a39 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.101721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-47013613-03d5-47af-9f73-1929d5158afe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.329891 Jun 16 17:44:51.102503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 76/149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:50 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:51.113056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:51.113812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:51.120414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.120937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.121655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.122223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.122911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-f004ec7e-b8ee-4585-8b8e-e6eab9fb4bd6 req-ecb005ed-dd18-478c-8158-4206781a0a39 service nova] Creating event network-vif-plugged:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:44:51.129102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-f004ec7e-b8ee-4585-8b8e-e6eab9fb4bd6 req-ecb005ed-dd18-478c-8158-4206781a0a39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045364 Jun 16 17:44:51.130346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 74/150] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:51.271554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.280465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-32a91263-8faa-4080-831a-28d4cb222a29 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.176653 Jun 16 17:44:51.281380 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 77/151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:51 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:51.416421 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:51.417262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:51.432609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.433471 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.434602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.435244 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.620336 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.629375 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.630889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.632205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cd8d1b7e-802b-4978-aca4-70e0b2a0b97a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.220879 Jun 16 17:44:51.638203 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 75/152] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:51 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:51.787858 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:51.790391 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:51.800007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.800845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.802979 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:51.803762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:51.946904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:51.956916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-304ed4e2-f6ab-4f3d-8480-5163b9559df7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.173349 Jun 16 17:44:51.964609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 78/153] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:51 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:52.089221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:52.090392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:52.094582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:52.098749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.099592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.100765 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.101365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.121619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:52.122244 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:52.129659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.130117 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.130896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.131336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.330501 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:52.345456 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a6a437f0-c0ce-4619-b778-db57b4b0a5a4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1548 microversion: 2.1 time: 0.260105 Jun 16 17:44:52.346040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 76/154] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:52 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1548 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:52.352104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:52.353623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:52.364076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:52.365621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.366305 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.367865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.368753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.371901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a472e241-75e0-4a44-a1b7-b084c391f9b4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.256797 Jun 16 17:44:52.373009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 79/155] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:52 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:52.378481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:52.379151 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:52.389122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.390359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.391204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.391712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.589020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-552a5dc3-0e5d-4a66-9ecc-8f20dc9c35e0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213629 Jun 16 17:44:52.589745 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 80/156] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:44:52 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:52.655660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:52.656694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:52.672802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.673439 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.675056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.679352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:52.704919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:52.713800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6f98cd13-2513-4afd-a7bb-259672b09fd9 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1314 microversion: 2.1 time: 0.365713 Jun 16 17:44:52.714396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 77/157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:52 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:52.911109 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:52.919194 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:52.920912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:52.922097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d672a2c3-1272-48ce-89ce-f0f72aacb6e6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.275174 Jun 16 17:44:52.922916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 81/158] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:52 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:52.975396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:52.976001 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:52.984346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:52.999829 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.003008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.003455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.144959 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-c4480990-8703-42db-a76c-0a0305177f45 req-076e3369-5b57-4198-9ac4-696830980b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d06d37-30c0-455b-b00a-bc4b9311be03", "name": "network-vif-plugged", "status": "completed", "tag": "af63ecca-47fb-44c6-a4ae-a10a439cdfda"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:53.161129 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-c4480990-8703-42db-a76c-0a0305177f45 req-076e3369-5b57-4198-9ac4-696830980b4e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.162391 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-c4480990-8703-42db-a76c-0a0305177f45 req-076e3369-5b57-4198-9ac4-696830980b4e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.194093 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-c4480990-8703-42db-a76c-0a0305177f45 req-076e3369-5b57-4198-9ac4-696830980b4e service nova] Creating event network-vif-plugged:af63ecca-47fb-44c6-a4ae-a10a439cdfda for instance 63d06d37-30c0-455b-b00a-bc4b9311be03 on hv-cinder-83754 Jun 16 17:44:53.210868 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-c4480990-8703-42db-a76c-0a0305177f45 req-076e3369-5b57-4198-9ac4-696830980b4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066061 Jun 16 17:44:53.211985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 82/159] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:53.379660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:53.393511 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:53.394646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:53.396402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6b92d95e-f1ad-45b9-9b86-a945c9de3190 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.422220 Jun 16 17:44:53.399183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 78/160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:52 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:53.405473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.408059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.424193 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.424615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.730992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:53.731705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:53.738134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.738666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.739530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.740165 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.749723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:53.758403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-48d961b0-a184-459b-9057-f8ca8039f542 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.369980 Jun 16 17:44:53.759235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 83/161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:53 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:53.879250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:53.888119 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-79db92e1-a839-453c-9a37-711730fe209c tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1500 microversion: 2.1 time: 0.160937 Jun 16 17:44:53.889182 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:53 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:53.941933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:53.942939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:53.951848 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.953334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:53.954175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:53.955184 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:54.118779 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:54.123017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:54.131574 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:54.133526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:54.134824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1e078da6-4f4a-4633-8050-a6e1cd8dea1d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.197569 Jun 16 17:44:54.135704 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 84/163] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:53 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:54.199250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-e67b75d2-e8b0-4a9c-929d-a03591f18bdc req-db3a576d-203b-4aec-8e03-3c92083f9576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6228596e-39a4-457c-bdad-6fb60dc046f6", "tag": "4b250132-04cb-44f4-9f14-4f5e43091658"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:54.216888 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e67b75d2-e8b0-4a9c-929d-a03591f18bdc req-db3a576d-203b-4aec-8e03-3c92083f9576 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:54.217414 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e67b75d2-e8b0-4a9c-929d-a03591f18bdc req-db3a576d-203b-4aec-8e03-3c92083f9576 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:54.225021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:54.243264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-e67b75d2-e8b0-4a9c-929d-a03591f18bdc req-db3a576d-203b-4aec-8e03-3c92083f9576 service nova] Creating event network-changed:4b250132-04cb-44f4-9f14-4f5e43091658 for instance 6228596e-39a4-457c-bdad-6fb60dc046f6 on hv-cinder-83754 Jun 16 17:44:54.265785 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-e67b75d2-e8b0-4a9c-929d-a03591f18bdc req-db3a576d-203b-4aec-8e03-3c92083f9576 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069932 Jun 16 17:44:54.274544 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 80/164] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:54.416297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:54.417177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:54.428586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:54.429329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:54.430739 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:54.431395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:54.648464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:54.657572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-30e864bf-c822-445e-9cdb-2ccce15dff3a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.246384 Jun 16 17:44:54.658145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 85/165] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:54 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:54.781942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:54.783517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:54.792735 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:54.793189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:54.793962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:54.794667 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:54.993282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:55.004777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4853a04c-35b3-449b-9d91-ecffc578dbc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.230798 Jun 16 17:44:55.015917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 81/166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:54 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:55.154061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:55.155402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:55.161951 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:55.162909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:55.163988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:55.164698 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:55.355509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:55.372052 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aee84d37-f958-4719-bcf7-4b44ccaf6bf7"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:55.374272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:55.377070 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:55.379204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:55.380714 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-41331fdf-076d-46bd-954c-104e8748c292 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1407 microversion: 2.20 time: 0.231210 Jun 16 17:44:55.393402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 86/167] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:55 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:44:55.394035 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:55.394671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:55.395489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:55.395894 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:55.674612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:55.675465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:55.681526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:55.681973 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:55.682847 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:55.683285 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:55.840198 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:55.857320 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cafbbe13-646a-4c42-9360-fac494c6da14 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.186071 Jun 16 17:44:55.858647 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 87/168] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:55 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:56.025172 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:56.026948 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:56.037292 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:56.037745 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:56.038749 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:56.039491 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:56.254721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:56.263712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e5fba287-e32d-4680-891e-652f4c82ab21 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.243481 Jun 16 17:44:56.264588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:56 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:56.401027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:56.401675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:56.408584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:56.409028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:56.409788 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:56.410218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:56.555694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:56.564624 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:56.566096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:56.567455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-40903d67-b96c-41e4-a640-5cceeb555ca4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1600 microversion: 2.20 time: 0.170238 Jun 16 17:44:56.568005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 89/170] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:44:56 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:44:56.585525 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:56.586010 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:56.592241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:56.592712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:56.593473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:56.593906 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:57.000927 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-028071fc-6cbb-4b37-8173-ecdc046ea2a6 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "POST /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.632957 Jun 16 17:44:57.001629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 82/171] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:44:55 2022] POST /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f/os-volume_attachments => generated 194 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:57.002889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-115083eb-7c63-405b-813b-0890bb39d595 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.420938 Jun 16 17:44:57.003708 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 90/172] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Jun 16 17:44:56 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-interface => generated 285 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:44:57.016150 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:57.016799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:57.023926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:57.024753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:57.025736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:57.026325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:57.282515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:57.283133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:57.298243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:57.298774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:57.303931 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:57.304672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:57.354532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:57.366005 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d6aa583a-eb61-4ab6-b708-1ae5e6758000 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.359988 Jun 16 17:44:57.377032 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 83/173] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:57 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:57.668516 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:57.680120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e1a8729e-a524-4947-9820-b1d901344be8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.400824 Jun 16 17:44:57.681203 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 91/174] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:57 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:58.254423 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-e7cc4c0f-f44f-417b-b597-ce83036674da req-7ec6696e-13aa-48e5-88e4-bf5799d7f931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:58.263970 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e7cc4c0f-f44f-417b-b597-ce83036674da req-7ec6696e-13aa-48e5-88e4-bf5799d7f931 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:58.264424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e7cc4c0f-f44f-417b-b597-ce83036674da req-7ec6696e-13aa-48e5-88e4-bf5799d7f931 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:58.276334 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-e7cc4c0f-f44f-417b-b597-ce83036674da req-7ec6696e-13aa-48e5-88e4-bf5799d7f931 service nova] Creating event network-changed:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:44:58.281751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-e7cc4c0f-f44f-417b-b597-ce83036674da req-7ec6696e-13aa-48e5-88e4-bf5799d7f931 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 Jun 16 17:44:58.282670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 84/175] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:58.384616 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:58.385311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:58.392271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:58.392828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:58.393664 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:58.394984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:58.699251 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:58.699958 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:58.713217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:58.713940 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:58.714883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:58.715652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:58.792499 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:58.805528 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-662f44bb-358f-4b67-ba48-d3cbd3b25de8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.424219 Jun 16 17:44:58.807754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 92/176] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:58 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:58.966587 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:58.983196 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-609675e1-3c0c-4184-b834-5d1092ab46b1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1322 microversion: 2.1 time: 0.288040 Jun 16 17:44:58.992545 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 85/177] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:58 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:59.822916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:59.823527 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:59.830033 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:59.830477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:59.831236 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:59.831666 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:59.969219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:59.977347 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f6ea9a9a-df1d-44dd-a083-cafea4a22b28 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.158286 Jun 16 17:44:59.977972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 93/178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:59 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:00.000003 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:00.000646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:00.007427 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:00.007881 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:00.008936 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:00.009373 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:00.138908 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:00.146338 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fb21982b-5410-4743-acb5-426fe6cf5da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1515 microversion: 2.1 time: 0.150265 Jun 16 17:45:00.146908 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 86/179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:59 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:00.163386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:45:00.164427 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:00.170912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:00.171360 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:00.172123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:00.173192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:00.197563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lazy-loading 'flavor' on Instance uuid 63d06d37-30c0-455b-b00a-bc4b9311be03 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:45:00.328262 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e8aedc67-565b-4a94-8a1b-be7a1246774f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03/action" status: 200 len: 32 microversion: 2.1 time: 0.168782 Jun 16 17:45:00.328916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 94/180] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:45:00 2022] POST /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:45:00.340500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:00.341926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:00.348214 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:00.348795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:00.349638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:00.350147 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:00.481790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:00.489416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-198cc68f-3a69-49ef-821a-9edfec88dd01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.155514 Jun 16 17:45:00.489983 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 87/181] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:00 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:00.995608 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:00.996314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:01.003758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:01.004214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:01.005009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:01.005448 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:01.133817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:01.141385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1243346e-aeae-4b70-85cb-ba9f2935c67f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.150223 Jun 16 17:45:01.141968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 95/182] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:00 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:01.506713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:01.507258 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:01.515609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:01.516061 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:01.516867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:01.517303 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:01.649964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:01.658072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cffc5493-0401-4f70-9361-045a78f830bd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.155339 Jun 16 17:45:01.662404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 88/183] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:01 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:01.759028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-78b4064e-0470-428f-9b19-d4e4b28a526b req-69ba3d08-4e2d-4a84-9f3a-7cf92ac10791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1a3f32-7aab-4b92-81cf-74a18b529bff", "name": "network-vif-plugged", "status": "completed", "tag": "2efcc93f-177c-4f73-9e55-6b3af38cc596"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:45:01.773255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-78b4064e-0470-428f-9b19-d4e4b28a526b req-69ba3d08-4e2d-4a84-9f3a-7cf92ac10791 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:01.773771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-78b4064e-0470-428f-9b19-d4e4b28a526b req-69ba3d08-4e2d-4a84-9f3a-7cf92ac10791 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:01.930385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-78b4064e-0470-428f-9b19-d4e4b28a526b req-69ba3d08-4e2d-4a84-9f3a-7cf92ac10791 service nova] Creating event network-vif-plugged:2efcc93f-177c-4f73-9e55-6b3af38cc596 for instance dc1a3f32-7aab-4b92-81cf-74a18b529bff on hv-cinder-83754 Jun 16 17:45:01.936438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-78b4064e-0470-428f-9b19-d4e4b28a526b req-69ba3d08-4e2d-4a84-9f3a-7cf92ac10791 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182059 Jun 16 17:45:01.937180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 96/184] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:45:02.158952 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:02.159473 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:02.165547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:02.165993 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:02.166753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:02.167181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:02.297897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:02.305340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2b09710f-5480-4b59-8738-fa17242d1587 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.150435 Jun 16 17:45:02.305893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 89/185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:02 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:02.675004 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:02.675619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:02.682102 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:02.682557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:02.683327 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:02.683765 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:02.812058 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:02.819561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4f5b66ad-7546-490c-9b0d-9e56feee276f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.148812 Jun 16 17:45:02.820123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 97/186] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:02 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:03.327590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:03.329058 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:03.336488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:03.337097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:03.337987 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:03.338569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:03.837052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:03.837571 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:03.844690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:03.845209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:03.846041 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:03.846595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:03.944951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:03.953292 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d21efa89-219a-441d-a310-164a1e8e8e16 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.630490 Jun 16 17:45:03.954159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 90/187] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:03 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:04.133891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:04.141559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ee96a476-775f-457e-8d39-448fbb3ed168 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.308437 Jun 16 17:45:04.142122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 98/188] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:03 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:04.969731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:04.970886 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:04.977426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:04.977881 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:04.978641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:04.979178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:05.157828 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:05.158936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:05.160101 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:05.166224 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:05.166404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e05e18bd-53fd-4653-a411-0ff6cf63ec94 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.200304 Jun 16 17:45:05.167011 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:05.167783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:05.168407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:05.173833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 91/189] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:04 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:05.357776 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:05.367456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7d9c7e5b-4a62-46ac-acbe-c6e251e06212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.213562 Jun 16 17:45:05.368040 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 99/190] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:05 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:06.183663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:06.184299 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:06.191498 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:06.191949 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:06.192732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:06.193210 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:06.378795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:06.385576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:06.386368 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:06.387543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3e428651-2663-40c8-8b91-cbe026cccf31 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.207850 Jun 16 17:45:06.388174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 92/191] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:06 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:06.393652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:06.394251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:06.395116 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:06.395651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:06.415327 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:06.555510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:06.564726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8ddbce83-4190-404e-86f6-fe9d4b14f1b6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.183949 Jun 16 17:45:06.574381 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 100/192] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:06 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:07.404514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:07.405706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:07.412975 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:07.413421 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:07.414185 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:07.414789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:07.552160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:07.559967 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f73e1d00-4a45-4a5b-bc4f-c68d05182594 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.159136 Jun 16 17:45:07.560551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 93/193] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:07 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:07.582990 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:07.583879 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:07.590876 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:07.591434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:07.592284 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:07.592846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:07.732539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:07.742905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f4155cd4-cd52-4e13-81fc-53b6c5faeca4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.164885 Jun 16 17:45:07.743661 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 101/194] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:07 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:08.577079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:08.577978 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:08.585283 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:08.585779 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:08.586567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:08.587002 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:08.722744 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:08.730605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-23e9c243-5de7-41c9-a941-b2c15c106068 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.158212 Jun 16 17:45:08.731183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 94/195] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:08 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:08.759870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:08.760522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:08.768344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:08.768835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:08.769617 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:08.770057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:08.951794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:08.959422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9a4d144d-07b6-434f-b9aa-970b01732116 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.203768 Jun 16 17:45:08.959976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 102/196] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:08 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:09.750225 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:09.751219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:09.761961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:09.763196 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:09.764718 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:09.765451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:09.912619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:09.920713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ad01788f-ae8c-4862-b1ba-8286e984a15c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.175684 Jun 16 17:45:09.921315 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 95/197] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:09 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:09.976107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:09.976757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:09.983486 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:09.983936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:09.984742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:09.985180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:10.115987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:10.124219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7c7e809a-6961-4731-8c61-b3d948ee9417 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.151886 Jun 16 17:45:10.124825 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 103/198] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:09 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:10.938048 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:10.939303 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:10.951661 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:10.952208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:10.952922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:10.953358 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:11.112791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:11.116268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:11.121158 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8e74a0ef-bfcb-4a94-9b14-7c5588b1c270 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1366 microversion: 2.1 time: 0.187247 Jun 16 17:45:11.121724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 96/199] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:10 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:11.141771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:11.142384 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:11.148425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:11.148874 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:11.149623 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:11.150049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:11.279950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:11.287832 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a7909f71-792f-4ed7-8e77-4baaa198d53c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.150592 Jun 16 17:45:11.288415 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 104/200] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:11 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:12.148214 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:12.149388 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:12.156601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:12.157067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:12.157860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:12.158306 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:12.305566 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:12.306269 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:12.307156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:12.313872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:12.314324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:12.314440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f588d1d0-8a19-45c4-8d8c-ea7e4db7dc06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1556 microversion: 2.1 time: 0.178160 Jun 16 17:45:12.314992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 97/201] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:12 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:12.315131 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:12.315522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:12.339545 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:12.340142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:12.348944 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:12.348944 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:12.349866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:12.352723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:12.470046 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-593e01d4-d396-407c-bc45-5ea1c3f59dd3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141905 Jun 16 17:45:12.470638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 98/202] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:45:12 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:45:12.501128 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:12.509288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d65f1b52-7d9b-4fd7-9cd4-c8dd5604c09b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.207335 Jun 16 17:45:12.510707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 105/203] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:12 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:13.182936 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:13.183439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:13.190020 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.190468 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.191224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.191656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.223134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:45:13.322508 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2cb1a25f-6f99-4a7a-bb9e-3f7f1a084c93 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 204 len: 0 microversion: 2.1 time: 0.143440 Jun 16 17:45:13.323165 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 99/204] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:45:13 2022] DELETE /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:45:13.332937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:13.333749 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:13.341518 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.342065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.343216 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.343746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.527566 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:13.528297 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:13.530322 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:13.540789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.541269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.541558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5a45992d-bde8-44f4-a787-e16aebb84ca1 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1552 microversion: 2.1 time: 0.212366 Jun 16 17:45:13.542364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.542856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 106/205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:13 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1552 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:13.552699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.686783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-1fba0c0b-0f36-48f9-9d95-055a528c7544 req-55b93c43-b0ed-45bc-a8c7-9c9d3b659b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1a3f32-7aab-4b92-81cf-74a18b529bff", "tag": "2efcc93f-177c-4f73-9e55-6b3af38cc596"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:45:13.696190 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1fba0c0b-0f36-48f9-9d95-055a528c7544 req-55b93c43-b0ed-45bc-a8c7-9c9d3b659b5e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:13.696696 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1fba0c0b-0f36-48f9-9d95-055a528c7544 req-55b93c43-b0ed-45bc-a8c7-9c9d3b659b5e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:13.709975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-1fba0c0b-0f36-48f9-9d95-055a528c7544 req-55b93c43-b0ed-45bc-a8c7-9c9d3b659b5e service nova] Creating event network-changed:2efcc93f-177c-4f73-9e55-6b3af38cc596 for instance dc1a3f32-7aab-4b92-81cf-74a18b529bff on hv-cinder-83754 Jun 16 17:45:13.717465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-1fba0c0b-0f36-48f9-9d95-055a528c7544 req-55b93c43-b0ed-45bc-a8c7-9c9d3b659b5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034269 Jun 16 17:45:13.720554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 107/206] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:45:13.730795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:13.739234 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6447e13c-b8f7-4d13-bd4c-789fdf897f8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.215835 Jun 16 17:45:13.739811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 100/207] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:13 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:14.560260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:14.561001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:14.567382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:14.567839 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:14.568638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:14.569080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:14.717336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:14.725668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-91e6eb8d-4c3a-4d0d-b3b0-baf73f01a422 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1552 microversion: 2.1 time: 0.170322 Jun 16 17:45:14.726241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 108/208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:14 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:14.756334 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:14.756977 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:14.764699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:14.765157 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:14.765935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:14.766377 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:14.900307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:14.907984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-077fa0fc-b380-4618-ab04-e5a27f4fb288 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.155495 Jun 16 17:45:14.908590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 101/209] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:14 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:15.742745 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:15.743388 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:15.749438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:15.749890 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:15.750680 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:15.751122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:15.877971 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:15.886283 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-14bfd942-06bb-42ed-b7ae-64a60fb5b69e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1552 microversion: 2.1 time: 0.147434 Jun 16 17:45:15.886849 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 109/210] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:15 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:15.924605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:15.925217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:15.931691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:15.932143 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:15.932938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:15.933377 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:16.072782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:16.081149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-76f3470c-8d68-48ea-bcf8-14e1e225e9f0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.160343 Jun 16 17:45:16.081655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 102/211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:15 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:16.905082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:16.905757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:16.911789 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:16.912240 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:16.913047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:16.913489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:17.040611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:17.049295 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4bf1e2b7-8813-4e15-b996-283d16401f1e tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1552 microversion: 2.1 time: 0.148741 Jun 16 17:45:17.049865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 110/212] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:16 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:17.097437 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:17.098051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:17.104699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:17.105192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:17.105925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:17.107228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:17.238529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:17.246006 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-44b3b11e-8991-4bf7-832a-dfe87c81eced tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.152372 Jun 16 17:45:17.246594 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 103/213] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:17 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:18.066610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:18.067225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:18.069413 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=81 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:18.075656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:18.076479 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:18.077815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:18.078616 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:18.235933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:18.243932 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-14261bf0-1d85-4e97-b100-646ab3f32fbd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1552 microversion: 2.1 time: 0.181248 Jun 16 17:45:18.244524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 111/214] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:18 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:18.263269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:18.263873 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:18.270383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:18.270841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:18.271610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:18.272049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:18.737629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:18.745083 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b38624c2-87bd-4e6d-99ab-55d14aed62c1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.486515 Jun 16 17:45:18.745649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 104/215] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:18 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:19.266685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:19.267220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:19.285307 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:19.285762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:19.287361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:19.288916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:19.328313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-9a23e448-1269-423d-a3c7-20fe7608986c req-ee265242-0275-464b-acc0-870024b071b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f41ab89-366a-4e5a-bc54-8033b67ed35f", "name": "network-vif-deleted", "tag": "02aba641-872c-491e-ba26-a9743d7f14f4"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:45:19.347769 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-9a23e448-1269-423d-a3c7-20fe7608986c req-ee265242-0275-464b-acc0-870024b071b0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:19.348211 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-9a23e448-1269-423d-a3c7-20fe7608986c req-ee265242-0275-464b-acc0-870024b071b0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:19.362651 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-9a23e448-1269-423d-a3c7-20fe7608986c req-ee265242-0275-464b-acc0-870024b071b0 service nova] Creating event network-vif-deleted:02aba641-872c-491e-ba26-a9743d7f14f4 for instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f on hv-cinder-83754 Jun 16 17:45:19.369031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-9a23e448-1269-423d-a3c7-20fe7608986c req-ee265242-0275-464b-acc0-870024b071b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044310 Jun 16 17:45:19.369557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 105/216] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:45:19.370107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:19.379813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-fda0e570-40d4-453e-a53b-85994e65b520 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1510 microversion: 2.1 time: 0.121631 Jun 16 17:45:19.380413 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 112/217] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:19 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1510 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:19.763447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:19.764146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:19.770361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:19.770817 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:19.771588 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:19.772027 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:19.900677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:19.909629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-04128c9f-79a1-4066-bb6f-54043354ecb7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.150170 Jun 16 17:45:19.910489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 106/218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:19 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:20.397514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:20.398336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:20.405099 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:20.405585 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:20.406362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:20.406791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:20.442227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:20.442677 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:20.443116 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lazy-loading 'fault' on Instance uuid 9f41ab89-366a-4e5a-bc54-8033b67ed35f {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:45:20.493595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e577b2f2f18a4be397b6ea6e7f1ba0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375c9f75db854f22a560c9f6408f16b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:20.502166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-fe3b16d5-4789-462c-951a-353ca28cb194 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 200 len: 1350 microversion: 2.1 time: 0.108660 Jun 16 17:45:20.514229 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 113/219] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:20 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:20.926531 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:20.927132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:20.933520 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:20.934475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:20.935389 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:20.935831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:21.089691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:21.097513 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e3212bbe-e048-4494-b896-dca578b3242e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.174773 Jun 16 17:45:21.098084 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 107/220] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:20 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:21.519637 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:21.520242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:21.526292 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:21.526739 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:21.527497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:21.529119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:21.543173 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] HTTP exception thrown: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Request method failure captured: Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f HTTP/1.1 Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vkAeSdnsMwWJiHd4mRfRqZctmHuTLAVBssCOZsHS4ISW4dgiNGFjeTxDDyGNlkwfp3_jUUgoafPQvze9IcXTI7C67tPJ_CObiSTAOWFGfGcQItdMhoBz41abgg_DIAEo5aHwM8LRw_9VPJyeOK0G_50tllK0xOB-s-y7sVSdjALpU Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:45:21.548903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_375c9f75db854f22a560c9f6408f16b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: e577b2f2f18a4be397b6ea6e7f1ba0ad Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.550465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '9f41ab89-366a-4e5a-bc54-8033b67ed35f'} Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:45:21.551485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.554319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.555649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Returning 404 to user: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:45:21.555649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-06854d8c-6060-4c36-ab5c-c2dff8b2e5c2 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 404 len: 111 microversion: 2.1 time: 0.034568 Jun 16 17:45:21.555649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 114/221] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:21 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:45:21.662699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:21.663675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:21.669897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:21.670348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:21.671117 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:21.671567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:21.685434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] HTTP exception thrown: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Request method failure captured: Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f/os-volume_attachments HTTP/1.1 Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vkAeSdnsMwWJiHd4mRfRqZctmHuTLAVBssCOZsHS4ISW4dgiNGFjeTxDDyGNlkwfp3_jUUgoafPQvze9IcXTI7C67tPJ_CObiSTAOWFGfGcQItdMhoBz41abgg_DIAEo5aHwM8LRw_9VPJyeOK0G_50tllK0xOB-s-y7sVSdjALpU Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:45:21.690288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_375c9f75db854f22a560c9f6408f16b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: e577b2f2f18a4be397b6ea6e7f1ba0ad Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.691644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'server_id': '9f41ab89-366a-4e5a-bc54-8033b67ed35f'} Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:45:21.695563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:21.697154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:21.698937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Returning 404 to user: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:45:21.698937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-65f2ae68-6af6-4f00-99ac-0981ff711816 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032986 Jun 16 17:45:21.698937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 108/222] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:45:21 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:45:22.114996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:22.115716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:22.122218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:22.122657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:22.123436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:22.123891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:22.340903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:22.351795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dca1fc69-6a23-40e2-b2d4-e830300d826e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.240647 Jun 16 17:45:22.352505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 115/223] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:22 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:23.061821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:23.062315 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:23.064809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:23.071438 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:23.073478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:23.074282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:23.075295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:23.090193 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] HTTP exception thrown: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Request method failure captured: Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f HTTP/1.1 Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vkAeSdnsMwWJiHd4mRfRqZctmHuTLAVBssCOZsHS4ISW4dgiNGFjeTxDDyGNlkwfp3_jUUgoafPQvze9IcXTI7C67tPJ_CObiSTAOWFGfGcQItdMhoBz41abgg_DIAEo5aHwM8LRw_9VPJyeOK0G_50tllK0xOB-s-y7sVSdjALpU Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:45:23.092715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_375c9f75db854f22a560c9f6408f16b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: e577b2f2f18a4be397b6ea6e7f1ba0ad Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.094124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '9f41ab89-366a-4e5a-bc54-8033b67ed35f'} Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:45:23.095123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.096416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.098372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Returning 404 to user: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:45:23.099332 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7bf1159d-d5ab-463e-b70d-29714c28dffd tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 404 len: 111 microversion: 2.1 time: 0.041975 Jun 16 17:45:23.102721 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 109/224] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:45:23 2022] DELETE /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:45:23.115423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:23.115423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] [instance: 9f41ab89-366a-4e5a-bc54-8033b67ed35f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:23.115423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:23.115423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:23.116535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:23.117049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:23.132016 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] HTTP exception thrown: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Request method failure captured: Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f HTTP/1.1 Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vkAeSdnsMwWJiHd4mRfRqZctmHuTLAVBssCOZsHS4ISW4dgiNGFjeTxDDyGNlkwfp3_jUUgoafPQvze9IcXTI7C67tPJ_CObiSTAOWFGfGcQItdMhoBz41abgg_DIAEo5aHwM8LRw_9VPJyeOK0G_50tllK0xOB-s-y7sVSdjALpU Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:45:23.133939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_375c9f75db854f22a560c9f6408f16b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/375c9f75db854f22a560c9f6408f16b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 375c9f75db854f22a560c9f6408f16b5 Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-DeleteServersTestJSON-91174200 Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: e577b2f2f18a4be397b6ea6e7f1ba0ad Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-DeleteServersTestJSON-91174200-project Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.135372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '9f41ab89-366a-4e5a-bc54-8033b67ed35f'} Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:45:23.136088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. Jun 16 17:45:23.138309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:45:23.139468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] Returning 404 to user: Instance 9f41ab89-366a-4e5a-bc54-8033b67ed35f could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:45:23.139468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ef8018e2-d14f-49b8-b246-63c79155bfc5 tempest-DeleteServersTestJSON-91174200 tempest-DeleteServersTestJSON-91174200-project] 10.222.0.42 "GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f" status: 404 len: 111 microversion: 2.1 time: 0.032190 Jun 16 17:45:23.139468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 116/225] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:23 2022] GET /compute/v2.1/servers/9f41ab89-366a-4e5a-bc54-8033b67ed35f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:45:23.369153 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:23.369877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:23.376919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:23.377672 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:23.378606 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:23.379158 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:23.548103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:23.556424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ea476185-5327-44f3-8980-5f13b4e0837d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.191149 Jun 16 17:45:23.557313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 110/226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:23 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:24.574409 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:24.576299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:24.582362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:24.582816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:24.583747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:24.584337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:24.745708 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:24.765332 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5bdfaedc-f250-4824-ac0d-1e997d61e40a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.191840 Jun 16 17:45:24.765956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 117/227] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:24 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:25.783284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:25.783898 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:25.789964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:25.790415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:25.791213 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:25.791691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:25.943733 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:25.963191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cc3b2a1e-db44-4b06-a0a2-7697212a43ce tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.183768 Jun 16 17:45:25.973647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 111/228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:25 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:26.984787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:26.985893 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:26.997808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:26.998827 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:26.999908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:27.000357 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:27.181103 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:27.184840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:27.191044 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e2c17a4b-98ba-4bfe-9540-65550f8d657b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.213205 Jun 16 17:45:27.202443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 118/229] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:26 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:28.207782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:28.208542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:28.216057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:28.216655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:28.217832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:28.218484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:28.383015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:28.393660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c0fd0797-d890-4ee4-b2de-d719ac47aa16 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.189777 Jun 16 17:45:28.394574 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 112/230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:28 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:29.412509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:29.413158 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:29.420697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:29.421130 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:29.422121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:29.422574 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:29.567003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:29.574916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ea13deda-079d-4da1-b854-91a156d56801 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.166141 Jun 16 17:45:29.575499 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 119/231] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:29 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:30.591047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:30.591656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:30.598350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:30.598801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:30.599573 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:30.600011 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:30.745770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:30.754402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-65f290ab-a44f-45c7-88d1-b0918839498d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.167163 Jun 16 17:45:30.764935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 113/232] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:30 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:31.773481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:31.774544 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:31.782020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:31.783108 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:31.783769 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:31.784283 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:31.961799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:31.970035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-84e4cc66-8bc5-4d9a-8248-afe4bc52a4a0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.200329 Jun 16 17:45:31.970730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 120/233] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:31 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:32.988812 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:32.989439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:32.996305 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:32.997210 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:32.998014 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:32.998856 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:33.014945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:33.159280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:33.167922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d8708f3e-1513-43f9-979f-07c7866c9c95 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.183337 Jun 16 17:45:33.176956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 114/234] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:32 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:34.185610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:34.186217 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:34.192289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:34.192760 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:34.193508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:34.193939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:34.327092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:34.334563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-74e57a7a-35dd-403c-a173-18f2776a9307 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.153279 Jun 16 17:45:34.335125 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 121/235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:34 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:35.351253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:35.351857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:35.359011 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:35.359474 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:35.360244 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:35.360984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:35.514009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:35.530633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b2ecf691-72be-4620-a6e3-165258854b01 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.183124 Jun 16 17:45:35.531209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 115/236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:35 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:36.546351 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:36.546969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:36.552996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:36.553540 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:36.554373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:36.554840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:36.691059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:36.699110 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dc72e4ad-f604-4b91-8cdf-67e3897bc776 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.156716 Jun 16 17:45:36.700486 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 122/237] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:36 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:37.718520 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:37.719133 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:37.725914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:37.726368 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:37.727138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:37.727638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:37.855209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:37.862912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8fb36168-d7f0-42d2-bfeb-795f29332dad tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.148933 Jun 16 17:45:37.863477 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:37 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:38.879401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:38.880040 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:38.886505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:38.887455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:38.888230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:38.888707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:39.022942 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:39.031104 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3e9ee600-c84b-41e3-8279-3bbea65d9229 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.155526 Jun 16 17:45:39.031669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 123/239] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:38 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:40.048874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:40.049511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:40.056366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:40.056854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:40.057701 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:40.058140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:40.196993 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:40.205628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-77bc236c-e022-4976-883c-699b065d1637 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.161664 Jun 16 17:45:40.206185 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 117/240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:40 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:41.222954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:41.223822 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:41.229996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:41.230555 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:41.231362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:41.231791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:41.373253 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:41.381107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ff9588cb-85bf-4315-b0af-9d92b7dc7455 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.162411 Jun 16 17:45:41.381617 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 124/241] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:41 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:42.398100 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:42.398610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:42.406358 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:42.406811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:42.407587 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:42.408031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:42.547452 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:42.555177 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a4d65bb1-38e2-47fd-99b1-8a59a547acc0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.160980 Jun 16 17:45:42.555760 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 118/242] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:42 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:43.574928 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:43.576253 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:43.582103 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:43.582568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:43.583322 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:43.583755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:43.714371 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:43.722276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-08d09323-ba2e-4f4f-92e8-8f0f95813f98 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.152701 Jun 16 17:45:43.723052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 125/243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:43 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:44.739408 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:44.740041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:44.746500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:44.746956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:44.747716 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:44.748809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:44.884925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:44.896626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d9bdcc62-cf1b-46b2-b157-d81f0bf82da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.160921 Jun 16 17:45:44.897207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 119/244] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:44 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:45.913405 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:45.914025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:45.920837 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:45.921292 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:45.922070 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:45.922515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:46.054958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:46.065308 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0b782557-745f-46a5-b66c-9cf82b7482e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.155809 Jun 16 17:45:46.066328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 126/245] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:45 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:47.082742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:47.083349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:47.090240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:47.090690 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:47.091453 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:47.091893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:47.227631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:47.236077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c0f5e73f-f802-480c-9637-32318b29b15c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.157201 Jun 16 17:45:47.237219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 120/246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:47 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:48.253444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:48.254062 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:48.256523 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=34 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:48.263285 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:48.264792 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:48.266535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:48.267413 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:48.414100 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:48.425569 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4be30644-5735-478f-a8a7-f88260cedf99 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1521 microversion: 2.1 time: 0.175792 Jun 16 17:45:48.429400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 127/247] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:48 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:49.447867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:49.449132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:49.455874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:49.456333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:49.457149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:49.457710 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:49.660078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:49.667647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-121228e7-ea3d-447d-92fd-b610bfc8b2aa tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1501 microversion: 2.1 time: 0.224451 Jun 16 17:45:49.668220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 121/248] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:49 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1501 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:49.683779 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:49.684611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:49.691770 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:49.692219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:49.693013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:49.693453 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:49.827370 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:49.835159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f4d9e7ef-b5ff-4b6e-b960-cd3d72ef8cac tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1515 microversion: 2.1 time: 0.155197 Jun 16 17:45:49.835733 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 128/249] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:49 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:51.250050 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:45:51.251041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:51.257860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:51.258309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:51.259406 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:51.259781 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:51.283938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lazy-loading 'flavor' on Instance uuid d948b628-6612-4dc0-adb7-2ba4bffc810c {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:45:51.399129 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-500007e0-fc24-4bc4-85eb-ff16fc5f93bc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/action" status: 200 len: 32 microversion: 2.1 time: 0.153553 Jun 16 17:45:51.399710 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 122/250] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:45:51 2022] POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:45:51.409122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:51.409851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:51.415976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:51.416455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:51.417219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:51.417660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:51.794428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:51.802374 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-613da8a1-3edb-413a-b381-7ef0bc27b855 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.397129 Jun 16 17:45:51.802966 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 129/251] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:51 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:52.821398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:52.822707 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:52.829893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:52.830382 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:52.831165 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:52.831609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:52.967667 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:52.975858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3a0a6859-3f50-4f9d-9de6-ffa301f85c58 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.160196 Jun 16 17:45:52.976455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 123/252] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:52 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:53.995061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:53.995685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:54.007205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:54.007659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:54.008724 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:54.009167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:54.146044 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:54.153727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7ad3c2d9-48a0-491b-957d-2dcc46b9c902 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.163950 Jun 16 17:45:54.154301 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 130/253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:53 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:55.171918 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:55.172498 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:55.174958 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=30 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:55.180459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:55.180852 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:55.181624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:55.182058 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:55.316076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:55.323671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0b7a92c1-be01-4879-8b52-b65d94b606a4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.156493 Jun 16 17:45:55.324179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 124/254] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:55 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:56.340901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:56.341639 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:56.347669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:56.348117 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:56.348903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:56.349346 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:56.486454 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:56.494143 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f44a4bcf-814c-49d6-97c5-0c613c373501 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.157059 Jun 16 17:45:56.494819 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 131/255] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:56 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:57.511465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:57.512263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:57.519040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:57.519593 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:57.520513 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:57.521012 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:57.667669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:57.676897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3a506947-b96d-4797-a398-017f138e4182 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.169586 Jun 16 17:45:57.680504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 125/256] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:57 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:45:58.696689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:58.697329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:58.704080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:58.704563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:58.705344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:58.705785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:58.905146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:45:58.915084 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1901561d-38a7-4b76-bd92-008f1a3374a5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.222127 Jun 16 17:45:58.916890 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 132/257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:58 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:45:59.934021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:45:59.935808 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:45:59.943624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:59.943624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:45:59.944758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:45:59.945092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:00.108680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:00.116349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b82455f0-6526-4a8b-9e35-35575b304add tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.186570 Jun 16 17:46:00.116963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 126/258] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:45:59 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:01.135361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:01.136267 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:01.143184 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:01.143715 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:01.144635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:01.145144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:01.149748 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=85 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:01.285244 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:01.292826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f8e2f576-6cd8-43ee-9e69-2269d0c84be0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.162709 Jun 16 17:46:01.293395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 133/259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:01 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:02.311595 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:02.312217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:02.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:02.320263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:02.321231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:02.321835 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:02.503026 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:02.511671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-257d1e10-4e9b-4bb6-87be-2a70a99130ae tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.204999 Jun 16 17:46:02.512699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 127/260] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:02 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:02.753023 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:02.754386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:02.765147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:02.765673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:02.766701 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:02.767334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:02.792305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-eeaab59f-8b3d-4f8a-acf3-9bc6cb6b47b5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/ips" status: 200 len: 146 microversion: 2.1 time: 0.043309 Jun 16 17:46:02.792910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 134/261] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:46:02 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:03.529153 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:03.529758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:03.536486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:03.537154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:03.537950 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:03.538391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:03.541055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:03.697326 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:03.706277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-54747674-0650-4a1b-987e-8c27e99f3e38 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.180900 Jun 16 17:46:03.706990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 128/262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:03 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:04.723324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:04.723935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:04.730085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:04.730532 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:04.731297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:04.731733 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:04.863000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:04.870599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-65dfc553-e6ba-4c33-8899-a407cbfb7606 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.151112 Jun 16 17:46:04.871167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 135/263] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:04 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:05.887933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:05.889159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:05.895946 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:05.896418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:05.897196 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:05.897633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:06.035218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:06.044008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-29337d57-3f8e-4ece-b80e-7dcd55915e90 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.159225 Jun 16 17:46:06.049675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 129/264] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:05 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:06.099844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:06.100421 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:06.106317 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:06.107408 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:06.108340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:06.108899 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:06.134992 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b24fa401-6714-43f2-8d23-949534d04c28 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/ips" status: 200 len: 153 microversion: 2.20 time: 0.038818 Jun 16 17:46:06.135569 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 136/265] 10.222.0.42 () {60 vars in 1288 bytes} [Thu Jun 16 17:46:06 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:46:06.367771 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1249992765", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:06.449096 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] validate_networks() for None {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:46:06.755228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:46:06.755791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:46:06.756310 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:46:06.756775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:46:06.757192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:46:06.768197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:06.768691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:06.769678 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:06.770119 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:06.787166 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Getting quotas for project bb35ec3efb8c4a35b70191ebacce35a9. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:06.791174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Getting quotas for user 7e7032bdea794e57a7d6d1ad1cd2439e and project bb35ec3efb8c4a35b70191ebacce35a9. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:06.803805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:46:06.810461 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:46:06.856211 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9fd41452-2f01-4f08-9c31-6b3869427a50 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492449 Jun 16 17:46:06.862277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 130/266] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:46:06.869667 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8de352cc-0ddb-42b7-a5cd-6c2de832eb39 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:06.870282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8de352cc-0ddb-42b7-a5cd-6c2de832eb39 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:06.939850 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8de352cc-0ddb-42b7-a5cd-6c2de832eb39 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:06.946680 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8de352cc-0ddb-42b7-a5cd-6c2de832eb39 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1215 microversion: 2.1 time: 0.080948 Jun 16 17:46:06.947435 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 137/267] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:06 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:06.965535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac9f2596-e92b-46b1-add8-3e2a45a43815"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:06.966729 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:06.972851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:06.973474 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:06.974291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:06.974661 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:07.059615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:07.061443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:07.068085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:07.068586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:07.069398 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:07.069837 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:07.230263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:07.239119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7e01aba6-160a-4e60-a5c0-06e8b3607a67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.183279 Jun 16 17:46:07.239734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 138/268] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:07 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:07.964059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:07.964709 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:07.971695 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:07.972139 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:07.972917 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:07.973345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:08.033681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:08.041197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a1966c6a-526d-4aa2-9027-85a31d7623a2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1219 microversion: 2.1 time: 0.081070 Jun 16 17:46:08.041757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 139/269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:07 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:08.256156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:08.256794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:08.263600 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:08.264451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:08.264855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:08.265294 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:08.395834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:08.403350 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0bd7eb57-1800-447b-981c-bcc1fd4cf263 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.150951 Jun 16 17:46:08.404476 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 140/270] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:08 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:09.058950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:09.059561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:09.066134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:09.066584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:09.067334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:09.067764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:09.127026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:09.134561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-68a2fb78-08aa-4613-a040-d250e75224c5 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1219 microversion: 2.1 time: 0.079453 Jun 16 17:46:09.135119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 141/271] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:09 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:09.420484 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:09.421096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:09.427592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:09.428189 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:09.429069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:09.429556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:09.561342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:09.568978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1440ad2f-a11e-48b1-98fd-564c81a4f320 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.152542 Jun 16 17:46:09.569545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 142/272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:09 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:09.850057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-af0de411-3f9d-47c1-b8d1-606f5deb5725 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.888784 Jun 16 17:46:09.850823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 131/273] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:46:06 2022] POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-volume_attachments => generated 194 bytes in 2890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:10.151102 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:10.151720 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:10.158428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:10.158881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:10.159646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:10.160089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:10.221097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:10.228456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-41322a3d-6f1a-42c6-9ebf-96b9027d9f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1267 microversion: 2.1 time: 0.081442 Jun 16 17:46:10.229021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 143/274] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:10 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:10.586928 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:10.587625 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:10.594951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:10.595403 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:10.596175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:10.596640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:10.779270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:10.786740 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e3232fce-3e79-4a0f-901e-680e80075f24 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.204673 Jun 16 17:46:10.787298 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 132/275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:10 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:11.246373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:11.246987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:11.254092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:11.254548 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:11.255320 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:11.255766 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:11.316330 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:11.323710 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6187efe1-1af6-4c89-bc29-1f73630358c2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1273 microversion: 2.1 time: 0.081272 Jun 16 17:46:11.324277 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 144/276] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:11 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:11.803493 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:11.804127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:11.811156 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:11.811602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:11.812365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:11.812820 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.011197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:12.019621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6099d87a-53f1-403c-aa6d-8d57a2b98983 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.219856 Jun 16 17:46:12.028945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 133/277] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:11 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:12.134131 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:12.134836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:12.141939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:12.142399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.143186 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:12.143627 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.167246 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lazy-loading 'flavor' on Instance uuid dd9a2013-38fe-499c-a84e-97e2ca6e48ea {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:46:12.339998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:12.341592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:12.348618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:12.349190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.349971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:12.350412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.426426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:12.436422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-927ce44a-a2ef-4b20-ab08-eaccfc547c09 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1273 microversion: 2.1 time: 0.100376 Jun 16 17:46:12.437163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 134/278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:12 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:12.475691 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-baac2101-8d03-47b6-b22e-939de3de937c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/action" status: 202 len: 0 microversion: 2.20 time: 0.346365 Jun 16 17:46:12.476517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 145/279] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jun 16 17:46:12 2022] POST /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:46:12.485382 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:12.485984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:12.491961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:12.492439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.493195 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:12.493626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:12.634160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:12.651254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:12.651254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:12.651254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d1d5cb99-aca7-4dd0-a14f-599763d937a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.165303 Jun 16 17:46:12.651572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 135/280] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:12 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:13.035877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:13.036610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:13.042878 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:13.043424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:13.044441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:13.044840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:13.181119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:13.189214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ba1bfbdc-da6a-46c1-8e12-f1cbcf1b7510 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.157553 Jun 16 17:46:13.189799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 146/281] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:13 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:13.453843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:13.454447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:13.460903 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:13.461348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:13.462097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:13.462531 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:13.524526 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:13.532599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-47bac514-f357-4db2-99a4-973981761266 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1273 microversion: 2.1 time: 0.083186 Jun 16 17:46:13.533170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 136/282] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:13 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:13.664546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:13.665171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:13.671920 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:13.672366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:13.673155 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:13.673584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:13.867409 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:13.876593 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:13.878202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:13.879479 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ae6948a9-32bd-42ad-b1e3-dbdd198d6a8b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.218810 Jun 16 17:46:13.880087 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 147/283] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:13 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:14.206517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:14.207159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:14.213996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:14.214460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:14.215431 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:14.215652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:14.470999 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:14.483582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8c1d3446-c0a1-4f1b-881f-a9b59ece0206 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.279871 Jun 16 17:46:14.484223 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 137/284] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:14 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:14.549446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:14.550682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:14.558188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:14.558889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:14.559917 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:14.561157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:14.860306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:14.877364 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7112bf3c-03d3-413b-81f0-d79206686f29 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.330852 Jun 16 17:46:14.878793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 148/285] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:14 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:14.902085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:14.902935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:14.911586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:14.912039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:14.913036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:14.913629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:15.292720 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:15.314380 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:15.316085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:15.317663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-31c898e6-024a-4841-ac4f-fb0d6a9d60b0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.422230 Jun 16 17:46:15.329013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 138/286] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:14 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:15.500959 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:15.501569 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:15.512537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:15.513022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:15.513871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:15.514965 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:15.539491 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:15.650062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-1b52aba6-f3ae-4abd-8d9d-4be4fabea171 req-d7a485ef-c11b-427f-a91e-b2d88389f830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee7e4f2-ab78-4840-96be-537c24b8e94c", "tag": "6691ada9-7e73-4033-a590-e290774302ef"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:15.666400 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1b52aba6-f3ae-4abd-8d9d-4be4fabea171 req-d7a485ef-c11b-427f-a91e-b2d88389f830 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:15.666868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1b52aba6-f3ae-4abd-8d9d-4be4fabea171 req-d7a485ef-c11b-427f-a91e-b2d88389f830 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:15.684149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-1b52aba6-f3ae-4abd-8d9d-4be4fabea171 req-d7a485ef-c11b-427f-a91e-b2d88389f830 service nova] Creating event network-changed:6691ada9-7e73-4033-a590-e290774302ef for instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c on hv-cinder-83754 Jun 16 17:46:15.690013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-1b52aba6-f3ae-4abd-8d9d-4be4fabea171 req-d7a485ef-c11b-427f-a91e-b2d88389f830 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043407 Jun 16 17:46:15.691175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 139/287] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:15.772793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:15.781851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d1696a89-c5dd-40e0-a21f-2a8d7d79b545 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.285736 Jun 16 17:46:15.782649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 149/288] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:15 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:15.900289 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:15.901032 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:15.908609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:15.909050 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:15.909815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:15.910246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:16.109400 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:16.119950 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-001e9405-f5b8-426d-9514-f99321711f7c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.224139 Jun 16 17:46:16.120850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 140/289] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:15 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:16.335323 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:16.335934 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:16.342437 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:16.342907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:16.343684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:16.344201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:16.479435 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:16.487894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:16.489434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:16.490596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2c4e036f-8af9-4223-a46c-a6ebcf68d52a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.159242 Jun 16 17:46:16.491157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 150/290] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:16 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:16.802079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:16.803758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:16.806205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:16.807237 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:16.814161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:16.814600 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:16.815534 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:16.815969 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:16.960586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:16.969187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a909bfc4-44d0-41ab-b810-017cfdcd5af7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.174126 Jun 16 17:46:16.969777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 141/291] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:16 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:17.137564 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:17.138163 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:17.141063 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:17.146316 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:17.146762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:17.147513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:17.147944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:17.280520 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:17.288754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-729d4866-7d9d-47a9-8d1f-fd541552f61f tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.155420 Jun 16 17:46:17.289553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 151/292] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:17 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:17.510247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:17.510977 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:17.517852 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:17.518299 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:17.519201 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:17.519640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:17.734230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:17.749641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:17.751169 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:17.752725 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-98175a56-4447-4651-8724-88839b864293 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.246719 Jun 16 17:46:17.753599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 142/293] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:17 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:17.990115 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:17.991389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:17.998297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:17.998993 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:17.999940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:18.000609 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:18.140405 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:18.148348 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9add20d9-4530-40b3-871a-6ddb757cf194 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.162933 Jun 16 17:46:18.149058 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 152/294] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:17 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:18.307930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:18.309378 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:18.316642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:18.317092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:18.317859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:18.318338 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:18.448628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:18.456016 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-29f7b51d-3fc1-4cc8-b33d-7fe4b2bbd505 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.151947 Jun 16 17:46:18.456595 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 143/295] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:18 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:18.772213 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:18.772935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:18.774907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=54 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:18.780930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:18.781479 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:18.782302 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:18.782801 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:18.933370 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:18.950930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:18.950930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:18.950930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-af6319f8-7aec-4df3-8c4c-1a7748ae15a1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.183410 Jun 16 17:46:18.952716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 153/296] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:18 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:19.166021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:19.166621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:19.173317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:19.173768 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:19.174598 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:19.175069 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:19.313901 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:19.316529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:19.323506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a4a0fbc2-57fb-463d-8fdc-d3e0b96acb7d tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.161233 Jun 16 17:46:19.324074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 144/297] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:19 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:19.473035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:19.473656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:19.479743 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:19.480196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:19.481013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:19.481451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:19.636596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:19.644274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a9014584-5bf7-4819-84ed-e05bf5ab2cc4 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.175141 Jun 16 17:46:19.644943 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 154/298] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:19 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:19.972878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:19.973564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:19.981146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:19.981601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:19.982377 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:19.982911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.067993 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:20.068638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:20.080255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:20.081147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.082578 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:20.087562 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.114694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3cf3e699-4368-4270-a91e-d05aabf3d0a4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/ips" status: 200 len: 150 microversion: 2.1 time: 0.050662 Jun 16 17:46:20.121047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 155/299] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:46:20 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:46:20.170482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:20.180463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:20.185556 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:20.187340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2c052ec3-0c68-4326-97c6-002eab5e3186 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.217797 Jun 16 17:46:20.190233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 145/300] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:19 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:20.348153 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:20.349309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:20.365069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:20.365865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.366905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:20.367701 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.558198 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:20.567875 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9a7ae776-1991-4598-82a5-c2941d3d3516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.228183 Jun 16 17:46:20.568723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 156/301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:20 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:20.662140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:20.662844 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:20.669580 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:20.670099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.671074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:20.671931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:20.865482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:20.873268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-67ff43b2-f5b2-4497-9834-da37eef2ca04 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.215075 Jun 16 17:46:20.873939 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 146/302] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:20 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:21.208590 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:21.209324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:21.215553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.215995 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.216803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.217242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.356758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:21.366391 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:21.367892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:21.369142 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e3557bd5-a556-4ddf-94db-b4148efd631d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.164430 Jun 16 17:46:21.369923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 157/303] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:21 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:21.586051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:21.587073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:21.595422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.596341 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.597392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.597997 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.629755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b63586c-8d29-4c1c-b540-95560930707d"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:21.630989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:21.637983 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.638461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.639243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.639901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.814573 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:21.822582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3d5584cf-07a3-4ac1-bb51-b80201801a1c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.240941 Jun 16 17:46:21.823148 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 147/304] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:21 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:21.891842 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:21.892489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:21.898756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.899440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:21.900433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:21.901064 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.166750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:22.176293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cbdee24c-354d-470a-aa4b-3306190d93ef tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.289794 Jun 16 17:46:22.177178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 148/305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:21 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:22.272701 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-464d00d3-2877-4a50-ab5c-19d4ce255dd4 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647331 Jun 16 17:46:22.273854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 158/306] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:46:21 2022] POST /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:22.390061 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:22.390723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:22.397086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:22.397539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.398818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:22.399265 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.506489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-5d8ec15e-6674-4768-8102-f5bccaa6ab0e req-6c72845a-0dd3-4196-bf9e-010776305343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee7e4f2-ab78-4840-96be-537c24b8e94c", "name": "network-vif-plugged", "status": "completed", "tag": "6691ada9-7e73-4033-a590-e290774302ef"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:22.518842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5d8ec15e-6674-4768-8102-f5bccaa6ab0e req-6c72845a-0dd3-4196-bf9e-010776305343 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:22.519297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5d8ec15e-6674-4768-8102-f5bccaa6ab0e req-6c72845a-0dd3-4196-bf9e-010776305343 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.533766 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-5d8ec15e-6674-4768-8102-f5bccaa6ab0e req-6c72845a-0dd3-4196-bf9e-010776305343 service nova] Creating event network-vif-plugged:6691ada9-7e73-4033-a590-e290774302ef for instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c on hv-cinder-83754 Jun 16 17:46:22.540143 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-5d8ec15e-6674-4768-8102-f5bccaa6ab0e req-6c72845a-0dd3-4196-bf9e-010776305343 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039346 Jun 16 17:46:22.541757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 159/307] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:46:22.586702 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:22.595138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:22.597107 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:22.598386 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4442d28f-758a-494e-8cd2-aa9898cf5f55 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.213612 Jun 16 17:46:22.609919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 149/308] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:22 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:22.841758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:22.842474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:22.857056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6e4b886e-d2ee-4645-80dd-2c2242c919ff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:22.862304 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:22.862868 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.864007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:22.864479 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.872165 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6e4b886e-d2ee-4645-80dd-2c2242c919ff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:22.872654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6e4b886e-d2ee-4645-80dd-2c2242c919ff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:22.943932 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6e4b886e-d2ee-4645-80dd-2c2242c919ff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Going to try to stop instance {{(pid=124158) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 17:46:23.036542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6e4b886e-d2ee-4645-80dd-2c2242c919ff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action" status: 202 len: 0 microversion: 2.1 time: 0.182720 Jun 16 17:46:23.038363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 150/309] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:46:22 2022] POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:46:23.061325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:23.067689 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:23.087017 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:23.088409 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:23.090402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:23.090870 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:23.150985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:23.167377 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-850b22b2-0c03-4b2e-a2a2-1c6ef6c9f9fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.329091 Jun 16 17:46:23.168151 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 160/310] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:22 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:23.197428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:23.198481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:23.217527 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:23.218958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:23.222145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:23.222927 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:23.515828 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:23.520347 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:23.527158 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7617a800-6aef-4da4-b365-b176266111e4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.481825 Jun 16 17:46:23.528053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 151/311] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:23 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:23.543035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f0662e5c-b433-4ab4-beee-4f7654a71a9a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.347150 Jun 16 17:46:23.543704 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 161/312] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:23 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:23.620310 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:23.621363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:23.639942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:23.641848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:23.643166 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:23.645134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:23.809184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:23.818295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:23.819987 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:23.821314 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d781f4b8-32ed-4b86-9618-4a344ad0e9d9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.206310 Jun 16 17:46:23.821876 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 152/313] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:23 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:24.185051 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:24.186230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.194938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.195770 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.197242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.197885 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.474717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:24.490814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-997cfcdd-1fa4-4fb4-951c-a76d4fe0b5d2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1501 microversion: 2.1 time: 0.309475 Jun 16 17:46:24.504211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 162/314] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:24 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:24.509650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b874bfbf-8716-4ff5-8ce7-1d3edb292254"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:24.510777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.528853 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.529541 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.531079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.531713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.559411 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:24.560031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] HTTP exception thrown: Cannot 'attach_volume' instance d948b628-6612-4dc0-adb7-2ba4bffc810c while it is in vm_state rescued Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Request method failure captured: Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/os-volume_attachments HTTP/1.1 Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 74 Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vpZMBWfbYYv8MskhFdjKunGOLOW3u46steyppa9ycLucosvadyy1Z0Cv9eZXLnn_X3B2oENgqUbBw9XTYlK3LNrIJYCU0DEweCvNQ371qBo0NWO_5UsoOBIgnqL8VFksWOCaQC_FuMMCVDggwNXjJTZxjC8vzksPKbFTPoqIRSPFc Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:46:24.562198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feb571d68c6c4a1ab9e7b175f5a6e0b3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 268c5947a265492bb7a8f181f9f5c504 Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {"volumeAttachment": {"volumeId": "b874bfbf-8716-4ff5-8ce7-1d3edb292254"}} Jun 16 17:46:24.563902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Cannot 'attach_volume' instance d948b628-6612-4dc0-adb7-2ba4bffc810c while it is in vm_state rescued Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'server_id': 'd948b628-6612-4dc0-adb7-2ba4bffc810c', 'body': {'volumeAttachment': {'volumeId': 'b874bfbf-8716-4ff5-8ce7-1d3edb292254'}}} Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:46:24.564640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d948b628-6612-4dc0-adb7-2ba4bffc810c while it is in vm_state rescued Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:46:24.565680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:46:24.566728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:46:24.566728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:46:24.566728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d948b628-6612-4dc0-adb7-2ba4bffc810c while it is in vm_state rescued Jun 16 17:46:24.566728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:24.566728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Returning 409 to user: Cannot 'attach_volume' instance d948b628-6612-4dc0-adb7-2ba4bffc810c while it is in vm_state rescued {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:46:24.566728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2de354ae-ecbc-42d4-b2a3-086d5ed033fe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058286 Jun 16 17:46:24.567229 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.567318 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 153/315] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:46:24 2022] POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 17:46:24.572987 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:24.573842 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.577396 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.578912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.580473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.580732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.581200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.581460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.582013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.582459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.805185 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:24.805566 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:24.814718 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-11f36331-52d9-456c-ab82-be184aefccdb tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.272805 Jun 16 17:46:24.815603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 163/316] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:24 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:24.817690 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-12b9bafe-964a-4f7e-8481-f95930236b0c tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.251952 Jun 16 17:46:24.818649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 154/317] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:24 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:24.820385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:24.820918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.828619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.829183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.830775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.830775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.839833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:24.840580 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.850558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.851330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.852341 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.853333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.917782 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:24.941680 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4c03ac5e-0639-441b-9f3a-f22777eb2e9b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/action" status: 202 len: 0 microversion: 2.1 time: 0.124591 Jun 16 17:46:24.942266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 164/318] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:46:24 2022] POST /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:46:24.952677 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:24.953552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:24.965670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.966456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:24.967756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:24.969034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:25.303294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:25.318219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:25.320120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:25.321519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3a58aa53-7fd8-4fd4-b084-53050641c759 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.485858 Jun 16 17:46:25.333420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 155/319] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:24 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:25.376218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:25.390888 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c2bcf02e-7182-41e2-a5aa-0e49afce0da7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1509 microversion: 2.1 time: 0.443532 Jun 16 17:46:25.392300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 165/320] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:24 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:25.833582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:25.834257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:25.834869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:25.835355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:25.838596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:25.842043 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:25.842498 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:25.844644 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:25.844964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:25.846109 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:25.846804 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:25.847790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:25.848482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:26.059405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:26.074333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3ea032fe-a84a-4222-9e45-265390dc272c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.240957 Jun 16 17:46:26.092547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 156/321] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:25 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:26.148313 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:26.162884 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f810ab08-bd2e-46c5-97cd-1ffdd027ebbb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1315 microversion: 2.1 time: 0.332160 Jun 16 17:46:26.164086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 166/322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:25 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:26.344031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:26.345151 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:26.352674 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:26.353451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:26.354347 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:26.354913 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:26.409033 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:26.411404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:26.419318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:26.419318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:26.422787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:26.423245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:26.932901 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:26.944692 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:26.947473 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:26.949137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-362731b8-548d-428b-a627-17d615cc1abf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.610588 Jun 16 17:46:26.950326 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 157/323] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:26 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:26.965780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:26.975821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5f361386-5d33-41f8-aaef-876eddd4737b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1509 microversion: 2.1 time: 0.571243 Jun 16 17:46:26.976461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 167/324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:26 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1509 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:27.098583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:27.099347 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:27.108557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.109251 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.110139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.110678 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.181804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:27.182563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:27.190170 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.191173 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.192243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.193024 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.306951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:27.316815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-87d60fa3-9332-4873-9285-45b8a9b66e64 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.222455 Jun 16 17:46:27.317401 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 158/325] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:27 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:27.370759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:27.381507 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dcd35390-27b3-4a64-948d-7e34a63f65bb tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1464 microversion: 2.1 time: 0.204406 Jun 16 17:46:27.382095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 168/326] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:27 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:27.432071 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:27.432653 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:27.441122 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.441856 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.442980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.443545 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.473799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:46:27.518971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:27.589345 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5cc82cc3-babb-4138-b1ed-8b62667861b2 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 204 len: 0 microversion: 2.1 time: 0.161159 Jun 16 17:46:27.589933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 159/327] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:46:27 2022] DELETE /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:46:27.598546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:27.599150 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:27.610296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.610875 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.611516 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.611925 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.788291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:27.799581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4561e59d-e025-4737-92cd-113c8fc35a96 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1470 microversion: 2.1 time: 0.204780 Jun 16 17:46:27.800171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 169/328] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:27 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:27.968991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:27.969809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:27.976930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.977568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.978432 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:27.978963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:27.993475 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:27.994560 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:28.002710 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:28.003484 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:28.004603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:28.005886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:28.237514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:28.251112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:28.252864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:28.257283 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:28.267381 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b5245300-ce54-460f-a941-cb865acbb209 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.303355 Jun 16 17:46:28.268515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cb7648dd-07f8-4260-8f5f-e639c642e649 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1509 microversion: 2.1 time: 0.279327 Jun 16 17:46:28.269599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 170/329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:27 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:28.270395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 160/330] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:27 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:28.335983 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:28.337458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:28.344712 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:28.345325 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:28.348462 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:28.349054 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:28.572366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:28.581139 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8dcdd6d7-ba8d-4367-b049-5b0416ad2e6e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.250134 Jun 16 17:46:28.581849 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 171/331] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:28 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:28.817042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:28.818019 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:28.827198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:28.829000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:28.830238 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:28.830917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.121501 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:29.130274 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1464fca9-ee0b-4711-8178-5251d828301a tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1470 microversion: 2.1 time: 0.317031 Jun 16 17:46:29.131613 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 161/332] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:28 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:29.297414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:29.298343 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:29.299642 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:29.300095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:29.317871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:29.318945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:29.319473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.320011 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.320906 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:29.322440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:29.323098 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.323614 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.683776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:29.708489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:29.710751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:29.713514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-095f4c9a-28df-4ea4-82c8-c549d46eae58 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.429490 Jun 16 17:46:29.720173 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 162/333] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:29 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:29.725424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:29.726264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:29.732688 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:29.733623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.734687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:29.735308 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:29.741921 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:29.753373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-90d3287a-c030-4abe-b6b5-7e7609568ece tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1509 microversion: 2.1 time: 0.471009 Jun 16 17:46:29.753956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 172/334] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:29 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1509 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:29.950224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:29.960740 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f784f96e-e51d-4ef5-89ad-0318723858a1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.238987 Jun 16 17:46:29.961309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 163/335] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:29 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:30.149647 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:30.150266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:30.158300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:30.167746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:30.168997 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:30.169611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:30.582830 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:30.597474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c140e374-15ec-4715-980a-d574aea31245 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1470 microversion: 2.1 time: 0.451537 Jun 16 17:46:30.598697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 173/336] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:30 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1470 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:30.739360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:30.741629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:30.759449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:30.760854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:30.761858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:30.762460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:30.775717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:30.782457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:30.817680 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:30.821633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:30.829764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:30.830641 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:31.196328 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:31.219794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:31.220609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:31.222648 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:31.227964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-19d01df4-6c8b-4e42-897a-faed9fe5ddb0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1509 microversion: 2.1 time: 0.460204 Jun 16 17:46:31.230666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-08daf11f-a23b-4e84-9558-e5e96c510178 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.498948 Jun 16 17:46:31.231542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 164/338] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:30 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:31.233345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 174/338] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:30 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:31.246264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:31.247865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:31.264222 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:31.265914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:31.268322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:31.269208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:31.623611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:31.625342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:31.632847 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:31.633333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:31.634411 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:31.634860 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:31.756690 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:31.766934 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4b6f636b-0fb2-4b96-bbcf-2dd5bd44d89e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.533456 Jun 16 17:46:31.767516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 165/339] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:31 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:31.883918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:31.895278 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5e6726f0-2198-44fd-bf55-1b6d4170a9dd tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1470 microversion: 2.1 time: 0.275436 Jun 16 17:46:31.895955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 175/340] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:31 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:32.250395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:32.251167 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:32.257463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.262950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:32.263633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:32.267113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.270086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.271799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.272435 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.274912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.275799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.278998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.555726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:32.571660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b7149e98-2b4c-4b5b-a517-7114a978ad02 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1509 microversion: 2.1 time: 0.312055 Jun 16 17:46:32.573057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 176/341] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:32 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:32.574642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:32.587252 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:32.588953 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:32.590392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-48f3cf6f-6df7-436f-a799-0560ed64d226 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1746 microversion: 2.20 time: 0.344630 Jun 16 17:46:32.591740 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 166/342] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:32 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1746 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:32.785723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:32.786349 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:32.797492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.798877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.800693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.801778 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.920184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:32.922325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:32.929537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.930272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:32.931158 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:32.931917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:33.013487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:33.024956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-451e850e-2161-4c00-9857-5c229116f8be tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.243622 Jun 16 17:46:33.036550 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 177/343] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:32 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:33.127415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:33.138261 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8a27f170-1d29-41d5-9010-9976d174c4d3 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1470 microversion: 2.1 time: 0.229586 Jun 16 17:46:33.138944 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 167/344] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:32 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:33.591621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:33.593664 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:33.607503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:33.609762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:33.610670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:33.611284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:33.611974 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:33.613855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:33.620996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:33.622233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:33.623235 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:33.623865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:33.895177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:33.903050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6c19d4d0-dd8e-4edc-bab7-6c132c0816e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1515 microversion: 2.1 time: 0.316644 Jun 16 17:46:33.903730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 178/345] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:33 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:33.923889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-16f68886-59d1-4e5e-9462-afac8d3b3cc8 req-cb096fb6-c760-4fa3-9b9d-4d58d65e7616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee7e4f2-ab78-4840-96be-537c24b8e94c", "name": "network-vif-deleted", "tag": "6691ada9-7e73-4033-a590-e290774302ef"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:33.938754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-16f68886-59d1-4e5e-9462-afac8d3b3cc8 req-cb096fb6-c760-4fa3-9b9d-4d58d65e7616 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:33.939194 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-16f68886-59d1-4e5e-9462-afac8d3b3cc8 req-cb096fb6-c760-4fa3-9b9d-4d58d65e7616 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:33.965057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-16f68886-59d1-4e5e-9462-afac8d3b3cc8 req-cb096fb6-c760-4fa3-9b9d-4d58d65e7616 service nova] Creating event network-vif-deleted:6691ada9-7e73-4033-a590-e290774302ef for instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c on hv-cinder-83754 Jun 16 17:46:33.978089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-16f68886-59d1-4e5e-9462-afac8d3b3cc8 req-cb096fb6-c760-4fa3-9b9d-4d58d65e7616 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064466 Jun 16 17:46:33.979055 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 179/346] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:34.009605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:34.020102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:34.021648 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:34.022809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0b1b4f85-6b28-4ce2-81a5-80a78b13fe6e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1746 microversion: 2.20 time: 0.417784 Jun 16 17:46:34.034302 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 168/347] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:33 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1746 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:34.043431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:34.044350 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:34.053577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:34.054035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:34.054825 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:34.055247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:34.157402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:34.158903 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:34.183213 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:34.183679 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:34.184869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:34.186835 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:34.300796 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:34.308897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:34.320681 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8c66ab76-8d44-4b3d-81fd-1238acc3b56b tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1300 microversion: 2.1 time: 0.169286 Jun 16 17:46:34.321964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 169/348] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:34 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:34.324928 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-75244913-8cbf-4948-85f1-a5468f5c7bc6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.285730 Jun 16 17:46:34.325425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 180/349] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:34 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:34.609592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-006283c9-1ac2-4454-b783-0877528acd7d req-c2fee682-2d32-4692-9c55-0dd1f1ad348c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "name": "network-vif-plugged", "status": "completed", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:34.627184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-006283c9-1ac2-4454-b783-0877528acd7d req-c2fee682-2d32-4692-9c55-0dd1f1ad348c service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:34.627876 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-006283c9-1ac2-4454-b783-0877528acd7d req-c2fee682-2d32-4692-9c55-0dd1f1ad348c service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:34.641924 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-006283c9-1ac2-4454-b783-0877528acd7d req-c2fee682-2d32-4692-9c55-0dd1f1ad348c service nova] Creating event network-vif-plugged:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:46:34.647669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-006283c9-1ac2-4454-b783-0877528acd7d req-c2fee682-2d32-4692-9c55-0dd1f1ad348c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044574 Jun 16 17:46:34.648931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 170/350] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:35.048340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:35.051064 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:35.069627 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.070237 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.071368 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.072119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.338139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:35.338850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:35.361108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.361565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.362360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.374556 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.417081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:35.433205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:35.435095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:35.437856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a059cc19-4ee2-446f-ad95-ed470e629e47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1746 microversion: 2.20 time: 0.400115 Jun 16 17:46:35.450233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 181/351] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:35 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1746 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:46:35.459022 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.460000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.460510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:35.460777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lazy-loading 'fault' on Instance uuid 8ee7e4f2-ab78-4840-96be-537c24b8e94c {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:46:35.461700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:35.473640 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.474490 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.475508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:35.476169 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:35.482146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:35.551781 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7032bdea794e57a7d6d1ad1cd2439e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb35ec3efb8c4a35b70191ebacce35a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:35.562396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e1886806-fe04-47df-a4a5-bb1b64330483 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 200 len: 1305 microversion: 2.1 time: 0.228488 Jun 16 17:46:35.563616 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 171/352] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:35 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:35.568701 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-38968c8d-a411-453c-9979-ef1d44e87251 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: .version_select at 0x7f288ca704c0>, body: {"keypair": {"name": "tempest-keypair-379238914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzZJU9/jdq6kehsV94IxHKgy/W6AImU7tPnKRDpzb0BaRm2SGc8zDUe+uCM5uc59q1C+WRmjT6b8ysXnMmrrW0mwRokNUxrZd9FeiI8ACwPEjcUYsblx+LTcqtjIq6JhQ=="}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:35.605888 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-38968c8d-a411-453c-9979-ef1d44e87251 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:35.612832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-38968c8d-a411-453c-9979-ef1d44e87251 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:35.680779 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-38968c8d-a411-453c-9979-ef1d44e87251 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115919 Jun 16 17:46:35.682507 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 172/353] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:46:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:35.707552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-72f5a01d-c00e-4984-b72e-1c8723667bed tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'create', calling method: .version_select at 0x7f288ca70f70>, body: {"keypair": {"name": "tempest-keypair-1340433655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvf6R60xrfme8gE5LZc3mJsQKIm+m2ry9ii/YfIHsqtSzppRD0NMdTNNjTg1BzktJ1hYu8vjMiSXeXq2QXORX/qCyAARtFDxVvvZzOVjJ8GB7ADoah9REn+1c46+DkhIw=="}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:35.732736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:35.742199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-40607827-6807-41de-a4fa-59b03434db74 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.290268 Jun 16 17:46:35.742785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 182/354] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:35 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:35.760595 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-72f5a01d-c00e-4984-b72e-1c8723667bed tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:35.768867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-72f5a01d-c00e-4984-b72e-1c8723667bed tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for user 268c5947a265492bb7a8f181f9f5c504 and project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:35.800839 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-72f5a01d-c00e-4984-b72e-1c8723667bed tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116059 Jun 16 17:46:35.801851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 173/355] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:46:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:36.459270 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:36.460177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:36.470283 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:36.472935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:36.476459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:36.477507 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:36.583020 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:36.584714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] [instance: 8ee7e4f2-ab78-4840-96be-537c24b8e94c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:36.598175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:36.605805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:36.607937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:36.609989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:36.672340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] HTTP exception thrown: Instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c could not be found. Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Request method failure captured: Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c HTTP/1.1 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2xbrtrW7mPDFQioNPrNapJN5Vlq3CO8OP0N5sc-0k6DwtWFUAZSS0wy35rimYjzkNTonQMcUXGT3oGtnJUsCCrnlId8l5jhn_LmBNY0cUsXzszyaEKvR4IXi5-b9uEh5bF723q_7GOuXuFkiGLQD1i_2asiBRW-E69FhTBEZealcs4 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: bb35ec3efb8c4a35b70191ebacce35a9 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-VolumesNegativeTest-958117151 Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:46:36.675669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb35ec3efb8c4a35b70191ebacce35a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb35ec3efb8c4a35b70191ebacce35a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb35ec3efb8c4a35b70191ebacce35a9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb35ec3efb8c4a35b70191ebacce35a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-VolumesNegativeTest-958117151 Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: bb35ec3efb8c4a35b70191ebacce35a9 Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-VolumesNegativeTest-958117151 Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-VolumesNegativeTest-958117151-project Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 7e7032bdea794e57a7d6d1ad1cd2439e Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-VolumesNegativeTest-958117151-project Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c could not be found. Jun 16 17:46:36.677065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '8ee7e4f2-ab78-4840-96be-537c24b8e94c'} Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c could not be found. Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:46:36.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c could not be found. Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c could not be found. Jun 16 17:46:36.679000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:46:36.686068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] Returning 404 to user: Instance 8ee7e4f2-ab78-4840-96be-537c24b8e94c could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:46:36.686068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3f4e218e-491e-4028-8b68-a96ab53bd598 tempest-VolumesNegativeTest-958117151 tempest-VolumesNegativeTest-958117151-project] 10.222.0.42 "GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c" status: 404 len: 111 microversion: 2.1 time: 0.102393 Jun 16 17:46:36.686068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 174/356] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:36 2022] GET /compute/v2.1/servers/8ee7e4f2-ab78-4840-96be-537c24b8e94c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:46:36.726470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:36.736008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:36.746065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:36.747333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f45e4f31-d636-4a15-b4c0-131279d3ab5a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1741 microversion: 2.20 time: 0.293343 Jun 16 17:46:36.753464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 183/357] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:36 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:36.762055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:36.762750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:36.790343 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:36.797910 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:36.798995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:36.800514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:37.098633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:37.125890 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bb3d94f3-bb77-40a3-be62-d35ac5a0771b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.369863 Jun 16 17:46:37.127426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 175/358] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:36 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:37.773259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:37.773812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:37.783208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:37.784621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:37.787955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:37.788895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:38.052672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:38.070601 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:38.075254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:38.083881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-82ad4407-a27e-4674-a083-67d7e42e8623 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1741 microversion: 2.20 time: 0.312504 Jun 16 17:46:38.090311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 184/359] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:37 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:38.143205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:38.143803 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:38.181907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:38.182394 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:38.183258 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:38.183709 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:38.518409 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:38.530876 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9f33cf39-3e39-4100-b3df-959f5093e53b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1723 microversion: 2.1 time: 0.389063 Jun 16 17:46:38.532802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 176/360] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:38 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:38.819975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-412499506", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73e06f90-3f8b-46da-a984-8f18b234443c"}], "security_groups": [{"name": "tempest-securitygroup--1935141038"}], "key_name": "tempest-keypair-379238914", "user_data": "}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:39.065380 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-583259325", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26d6efeb-cb64-4564-b4f9-c2eead44a479"}], "security_groups": [{"name": "tempest-securitygroup--1941770819"}], "key_name": "tempest-keypair-1340433655", "user_data": "}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:45.778422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=8 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:46.332265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] validate_networks() for [('73e06f90-3f8b-46da-a984-8f18b234443c', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:46:46.449687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] validate_networks() for [('26d6efeb-cb64-4564-b4f9-c2eead44a479', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:46:47.163386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:46:47.163813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:46:47.164292 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:46:47.164727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:46:47.165342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:46:47.183128 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.196025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.197511 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.198440 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.240497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:47.245865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:46:47.247059 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:46:47.247732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:46:47.248181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:46:47.249191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:46:47.252299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:47.264998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.265459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.266284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.267089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:46:47.269645 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:46:47.283768 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.333050 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:47.338222 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Getting quotas for user 268c5947a265492bb7a8f181f9f5c504 and project feb571d68c6c4a1ab9e7b175f5a6e0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:47.352904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:46:47.355576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:46:47.400653 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-05fca86f-56df-4d5a-89ad-0af3b66d0ad1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.584104 Jun 16 17:46:47.401953 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 185/361] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:46:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 8587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:46:47.408848 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:47.409802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:47.416916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.417746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.418904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.419489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.461992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-baed620e-6524-47a8-8ea7-e25630a35a70 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 8.401458 Jun 16 17:46:47.464508 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 177/362] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:46:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 8406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:46:47.477682 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:47.479663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:47.508511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.509543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.511552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:47.512229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:47.718345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:47.732561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:47.736083 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:47.737460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b0f95455-7b50-4235-9c81-8409c191ce83 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1741 microversion: 2.20 time: 0.334345 Jun 16 17:46:47.742200 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 186/363] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:47 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1741 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:47.753286 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-01f755bc-4105-4f01-ab90-0a196e7bb30f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Action: 'create', calling method: .version_select at 0x7f288c35d5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-622938686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjp1GgUncUJwMGsl+vGwAgR+A5UCwBk+Bbt08wID62vsQaUIJaGKmImJiMnvlLC4oe5fMmJwxv93yt1II+ouSxGZmlDf32UTAoLFnxlo8v6CwuG6F7dXsz5G4LZXDNsRQ=="}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:47.792326 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-01f755bc-4105-4f01-ab90-0a196e7bb30f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Getting quotas for project ac4c34d742f64d17b81d6a6171e66e84. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:47.797348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:47.806146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a3da825c-9031-4980-b4dd-33d3d7afe2e7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1700 microversion: 2.1 time: 0.339446 Jun 16 17:46:47.810227 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 178/364] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:47 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1700 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:47.813567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-01f755bc-4105-4f01-ab90-0a196e7bb30f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Getting quotas for user 03be2d45633949a7b416fc5a84b8f000 and project ac4c34d742f64d17b81d6a6171e66e84. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:47.818429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-58c7ca5f-d97b-4a3d-aac4-42852a021c1f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:47.823682 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-58c7ca5f-d97b-4a3d-aac4-42852a021c1f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:47.905128 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-01f755bc-4105-4f01-ab90-0a196e7bb30f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.159149 Jun 16 17:46:47.907952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 187/365] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:46:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:46:47.924422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-592462da-1c3b-448e-9325-da964d5bb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:47.926444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-592462da-1c3b-448e-9325-da964d5bb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:48.050231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-58c7ca5f-d97b-4a3d-aac4-42852a021c1f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:48.086664 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-58c7ca5f-d97b-4a3d-aac4-42852a021c1f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1240 microversion: 2.1 time: 0.270668 Jun 16 17:46:48.088491 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 179/366] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:47 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1240 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:48.114077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c5455b16-70ad-486e-8bdc-e0be2f1e7f85 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:48.132188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c5455b16-70ad-486e-8bdc-e0be2f1e7f85 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:48.135551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c5455b16-70ad-486e-8bdc-e0be2f1e7f85 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:48.150951 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-592462da-1c3b-448e-9325-da964d5bb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:48.164663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-592462da-1c3b-448e-9325-da964d5bb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1245 microversion: 2.1 time: 0.254506 Jun 16 17:46:48.168705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 188/367] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:47 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1245 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:48.181017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-761110384", "imageRef": "f018c38b-41d8-4a79-a874-6ecd06df1170", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-622938686", "networks": [{"uuid": "0dc04082-4bc0-4818-90e8-18009c266f9b"}]}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:48.197906 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:48.203786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:48.237816 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c5455b16-70ad-486e-8bdc-e0be2f1e7f85 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Going to try to start instance {{(pid=124158) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 17:46:48.330981 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c5455b16-70ad-486e-8bdc-e0be2f1e7f85 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action" status: 202 len: 0 microversion: 2.1 time: 0.235808 Jun 16 17:46:48.332996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 180/368] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:46:48 2022] POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:46:48.348619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:48.349816 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:48.367183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:48.368122 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:48.369512 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:48.370166 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:48.370780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] validate_networks() for [('0dc04082-4bc0-4818-90e8-18009c266f9b', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:46:48.912824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:48.929145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-49710ca4-3166-4376-90c9-206e71eb35f9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1709 microversion: 2.1 time: 0.591031 Jun 16 17:46:48.930386 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 181/369] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:48 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1709 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:48.935521 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:48.937642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:48.946187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:48.946849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:48.947919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:48.948546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.472465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:49.486681 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:49.488480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:49.489638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-811c9e64-59e8-46ae-ba1b-80e14e388615 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1741 microversion: 2.20 time: 0.558013 Jun 16 17:46:49.492671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 182/370] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:48 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1741 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:49.497415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:49.498267 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:49.500578 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:49.510728 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:46:49.511699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:46:49.512481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:46:49.513046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:46:49.514795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:46:49.517462 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.518024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.518911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.519469 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.531122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.531871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.533005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.534068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.567275 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Getting quotas for project ac4c34d742f64d17b81d6a6171e66e84. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:46:49.573097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Getting quotas for user 03be2d45633949a7b416fc5a84b8f000 and project ac4c34d742f64d17b81d6a6171e66e84. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:46:49.589053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:46:49.591276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f018c38b-41d8-4a79-a874-6ecd06df1170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:46:49.625574 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:49.638416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6dabef9b-5514-4e9a-8816-eed333e3cb05 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1292 microversion: 2.1 time: 0.144408 Jun 16 17:46:49.639548 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 183/371] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:49 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1292 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:49.654199 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:49.662333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:49.677456 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.679087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.679984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.681108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.724675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e56daa2d-198d-422a-8eb6-b1493fedc7c0 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553705 Jun 16 17:46:49.725345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 189/372] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:46:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:46:49.754651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-20084fbb-64ee-49fe-8ce4-62a66089abdc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:49.759244 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-20084fbb-64ee-49fe-8ce4-62a66089abdc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:49.910723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:49.925502 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-120329f4-f090-4a54-8425-df1cf8f8d485 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1297 microversion: 2.1 time: 0.284713 Jun 16 17:46:49.926806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 184/373] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:49 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1297 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:49.956294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:49.958062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:49.966497 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:49.995087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:49.995954 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.001629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:50.091684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-20084fbb-64ee-49fe-8ce4-62a66089abdc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:50.100267 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-20084fbb-64ee-49fe-8ce4-62a66089abdc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1257 microversion: 2.1 time: 0.356733 Jun 16 17:46:50.119123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 190/374] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:49 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1257 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:50.510259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:50.510867 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:50.518480 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.519221 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:50.520041 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.520485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:50.647455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:50.656866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a44b568d-209c-4124-ae3d-e22598ce638c tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1709 microversion: 2.1 time: 0.708297 Jun 16 17:46:50.657547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 185/375] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:49 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1709 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:50.662409 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:50.663209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:50.678446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.678908 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:50.679758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.680140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:50.812731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:50.824766 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3540e77a-2906-43f1-9647-232edc8c814e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1298 microversion: 2.1 time: 0.165788 Jun 16 17:46:50.825573 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 186/376] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:50 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:50.895383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:50.903488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:50.905140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:50.906520 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ab02f35b-621f-4a3c-af44-f140853d60a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1741 microversion: 2.20 time: 0.400515 Jun 16 17:46:50.907077 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 191/377] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:50 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1741 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:46:50.944074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:50.944642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:50.950713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.951186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:50.958419 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:50.958877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:51.025455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:51.033170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-de748230-07c0-443b-82a7-0dbe000cf9df tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1303 microversion: 2.1 time: 0.093482 Jun 16 17:46:51.033738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 187/378] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:50 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:51.129266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:51.129975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:51.136416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:51.136876 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:51.137651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:51.138090 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:51.354328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:51.361945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d650d575-e02d-4c71-a1ca-f028ba7caa3f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1253 microversion: 2.1 time: 0.242674 Jun 16 17:46:51.362944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 192/379] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:51 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1253 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:51.675592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:51.676218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:51.683617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:51.684082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:51.685278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:51.685737 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:51.851968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:51.852640 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:51.886896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:51.892495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:51.895267 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:51.897302 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.029138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.038892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1f285a44-9c13-485a-b77d-4ec87bf1bba6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1709 microversion: 2.1 time: 0.367719 Jun 16 17:46:52.039815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 188/380] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:51 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1709 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:52.045867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:52.046730 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:52.053291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:52.053742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.054511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:52.054963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.081025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.096945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3674ed64-304c-490f-b267-45f9f009c727 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1298 microversion: 2.1 time: 0.251624 Jun 16 17:46:52.097709 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 193/381] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:51 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1298 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:52.102980 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:52.103910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:52.113210 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:52.113965 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.115027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:52.115541 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.553245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.561911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8d3d44fb-dbcc-4b63-918b-cf769da4b8b2 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1303 microversion: 2.1 time: 0.462989 Jun 16 17:46:52.562494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 194/382] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:52 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1303 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:52.568619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:52.568619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:52.573915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:52.574633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.575637 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:52.576326 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:52.763089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.771596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-542e95cd-dab9-42a6-b44e-fcad1cc03efb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1315 microversion: 2.1 time: 0.207926 Jun 16 17:46:52.772366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 195/383] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:52 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:52.876031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.884438 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.885968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:52.887154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-99d5b8bf-ea9b-4c55-9c2a-ef1a8198fd82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.846070 Jun 16 17:46:52.887706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 189/384] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:52 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:53.056618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:53.057492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:53.065826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.066390 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.067455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.068214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.114777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:53.116470 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:53.127958 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.128438 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.129395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.130867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.494355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:53.503861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:53.504057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-26aeee5a-2e8a-4f09-aafe-0919003fd4ba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1713 microversion: 2.1 time: 0.451509 Jun 16 17:46:53.505478 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 196/385] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:53 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1713 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:53.512049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f3c8cde9-84df-4208-b02e-bd23f9b1659e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.401350 Jun 16 17:46:53.512910 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 190/386] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:53 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:53.579193 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:53.579841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:53.588592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.589052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.589841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.590282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.795122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:53.796737 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:53.798220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:53.806053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0aff3dd7-ecc7-4447-baa1-786d6ac3c08f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.231364 Jun 16 17:46:53.806635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 197/387] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:53 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:53.819558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.820328 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.821417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.821867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.906947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:53.907565 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:53.909186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:53.913880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.914335 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.915112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:53.915552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:53.925672 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-47fb38e7-e49b-4861-8452-5a2215a9b39f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1315 microversion: 2.1 time: 0.135468 Jun 16 17:46:53.926478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 191/388] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:53 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:54.096534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:54.109637 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:54.111406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:54.113043 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-43ef3a53-39e5-418a-92cd-65e5d460b33f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.210099 Jun 16 17:46:54.113612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 198/389] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:53 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:46:54.530145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:54.530763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:54.536904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.537358 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.538186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.538907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.587752 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-173f971a-4371-4cd1-b29c-490e2bb91ccd req-91b713a5-7c05-4edc-8a08-b8b04ecf09c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "name": "network-vif-unplugged", "status": "completed", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:46:54.596519 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-173f971a-4371-4cd1-b29c-490e2bb91ccd req-91b713a5-7c05-4edc-8a08-b8b04ecf09c3 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.597108 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-173f971a-4371-4cd1-b29c-490e2bb91ccd req-91b713a5-7c05-4edc-8a08-b8b04ecf09c3 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.611561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-173f971a-4371-4cd1-b29c-490e2bb91ccd req-91b713a5-7c05-4edc-8a08-b8b04ecf09c3 service nova] Creating event network-vif-unplugged:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:46:54.616894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-173f971a-4371-4cd1-b29c-490e2bb91ccd req-91b713a5-7c05-4edc-8a08-b8b04ecf09c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033161 Jun 16 17:46:54.617608 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 199/390] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:46:54.673706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:54.681313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7f039298-6667-4f01-9723-14f671d09d06 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.155635 Jun 16 17:46:54.681879 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 192/391] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:54 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:54.826972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:54.827593 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:54.833780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.834228 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.835002 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.835422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.942184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:54.942794 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:54.949276 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.949723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.950483 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:54.950915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:54.968622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:54.976216 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bc6ae879-6a44-4778-832f-3c2f3b144c85 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.154076 Jun 16 17:46:54.976865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 200/392] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:54 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:55.082475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:55.090909 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f1eabefc-fa94-4f12-b8f9-dccc5a283156 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.152484 Jun 16 17:46:55.091734 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 193/393] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:54 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:55.136742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:55.137343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:55.144761 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:55.145235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:55.146008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:55.146446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:55.305271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:55.314641 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:55.316470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:55.317682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f6ac6466-ad01-49b8-8287-738f57213a91 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.185185 Jun 16 17:46:55.318282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 201/394] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:55 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:55.699247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:55.699885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:55.706724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:55.707179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:55.708078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:55.708549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:55.858189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:55.868782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b2610d13-14c3-4cbc-8b26-57e20140d57a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.173798 Jun 16 17:46:55.870715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 194/395] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:55 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:55.993390 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:55.994041 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:56.001820 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.002277 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.003076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.003522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.109011 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:56.110240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:56.118590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.119401 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.120397 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.122178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.149438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:56.158862 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1ea16a8d-7245-4a62-a65f-7baad49a6678 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.169177 Jun 16 17:46:56.171344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 202/396] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:55 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:56.270463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:56.279063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-258eb681-3997-40d6-85f6-57fb3f2a9f98 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.175878 Jun 16 17:46:56.280674 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 195/397] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:56 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:56.336522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:56.337136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:56.343389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.343842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.344642 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.345094 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.495153 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:56.497473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:56.504581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:56.506114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:56.507291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2dde1624-90ba-41a9-b264-3650ab773b00 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.174719 Jun 16 17:46:56.507859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 203/398] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:56 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:56.887207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:56.890036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:56.897460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.897909 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.899034 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:56.899507 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:56.903886 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:57.080609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:57.088438 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1de87125-ebae-4a01-b08e-9673c962b40d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.205437 Jun 16 17:46:57.089052 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 196/399] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:56 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:57.177196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:57.178506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:57.184960 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:57.186049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:57.187361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:57.188135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:57.297806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:57.298469 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:57.305079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:57.305602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:57.306378 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:57.306811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:57.322820 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:57.335392 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:57.343836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dd4466b9-1262-4615-8637-b626a8336d22 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.170602 Jun 16 17:46:57.344556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 204/400] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:57 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:57.456530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:57.464215 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f4e6be76-519b-48a0-98af-df765f81509a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.171126 Jun 16 17:46:57.464825 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 197/401] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:57 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:46:57.527073 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:57.528110 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:57.536029 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:57.536843 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:57.537615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:57.538175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:57.695419 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:57.705025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:57.706459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:57.708365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0da771a5-382d-44a8-a715-ebd473193541 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.185894 Jun 16 17:46:57.709159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 205/402] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:57 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:58.106678 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:58.107351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:58.109974 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=8 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:58.115801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.116269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.117073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.117594 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.255923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:58.264687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6ac2439f-7661-4972-a926-d854880c739a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.161159 Jun 16 17:46:58.273878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 198/403] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:58 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:58.361099 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:58.361673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:58.376325 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.376786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.377567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.378003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.481441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:58.482056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:58.489483 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.490269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.491292 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.491947 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.551997 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:58.561187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8c700d53-f028-456e-8004-1df3471544cb tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.204666 Jun 16 17:46:58.565936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 206/404] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:58 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:58.671018 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:58.679081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3387c5a5-b85b-4aaf-ad6f-0ad739a139af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.201460 Jun 16 17:46:58.679671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 199/405] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:58 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:58.728279 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:58.728946 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:58.736325 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.737509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.737693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:58.738134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:58.886496 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:58.895841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:58.897413 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:58.898627 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9741d092-a24d-419d-91ff-76fa77da7a05 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.174300 Jun 16 17:46:58.899416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 207/406] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:58 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:46:59.282290 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:59.282905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:59.289393 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.289841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.290606 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.291044 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.433155 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:59.453695 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4fb1ee71-1493-4bb0-b72e-c3e3a56b00b5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.175793 Jun 16 17:46:59.454286 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 200/407] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:59 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:59.582865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:59.583648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:59.586080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=4 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:59.591543 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.592536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.593307 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.593827 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.699868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:59.700542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:59.707590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.708119 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.708945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.709390 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.777515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:59.786112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f8aeaf52-ac0b-4646-9df2-0bff279b5212 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.207626 Jun 16 17:46:59.796191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 208/408] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:59 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:59.867678 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:46:59.877123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7989f2e4-e316-4979-8aa1-77ed749bc4e7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.185226 Jun 16 17:46:59.877701 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 201/409] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:46:59 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:46:59.916748 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:46:59.917349 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:46:59.923843 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.924284 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:46:59.925073 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:46:59.925507 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:00.066009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:00.073997 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:00.075542 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:00.077261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f8fae681-aa70-4e23-b650-7b45638d21c7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.164372 Jun 16 17:47:00.077821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 209/410] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:46:59 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:00.478801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:00.480351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:00.501277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:00.502093 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:00.503420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:00.503810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:00.655829 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:00.664340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d7f9128e-997b-48c8-94e2-cb3479f0eb68 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.195668 Jun 16 17:47:00.665069 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 202/411] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:00 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:00.803347 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:00.812575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:00.818918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=20 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:00.822135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:00.822687 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:00.823621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:00.824190 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:00.895626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:00.895626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:00.902861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:00.903750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:00.904825 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:00.905434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:01.003191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:01.012407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-04588c6b-2123-4b5e-85f2-93f8930f5706 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.213097 Jun 16 17:47:01.013084 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 210/412] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:00 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:01.077069 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:01.084559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d7e56ef7-6161-4166-a8f8-fa88db727683 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.194009 Jun 16 17:47:01.085112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 203/413] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:00 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:01.095502 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:01.096108 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:01.102238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:01.102684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:01.103455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:01.103889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:01.260515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:01.272718 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:01.274375 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:01.278989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1c365dc1-9932-4b12-a31b-34328a4e7fc5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.187895 Jun 16 17:47:01.280140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 211/414] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:01 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:01.700900 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:01.701530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:01.709775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:01.710229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:01.711029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:01.711492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:01.851866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:01.862848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-249da0d4-9747-4c8e-ae05-c6fb20ce0ea0 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.179243 Jun 16 17:47:01.868306 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 204/415] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:01 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:02.029075 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:02.029909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:02.036394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.036869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.037642 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.038082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.107586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:02.108233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:02.114510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.114962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.115743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.116230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.242621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:02.253639 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c9d99f80-b5d1-474d-ac8e-9d9f73d5e53a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.228366 Jun 16 17:47:02.254645 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 212/416] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:02 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:02.299804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:02.300044 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:02.300453 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:02.306991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.307457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.307864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7e4d99ed-cfd8-4cf7-b175-06daff1f2748 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.209713 Jun 16 17:47:02.308233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.309240 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.309391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 205/417] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:02 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:02.453148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:02.461670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:02.463188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:02.464391 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ad1acc1f-b841-4d9b-aa7f-ac17ce5ae432 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.168449 Jun 16 17:47:02.464951 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 213/418] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:02 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:02.879484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:02.886472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:02.894286 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.894791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:02.895525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:02.895969 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.063084 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:03.070891 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a7ea0d2b-0cb6-428e-a24e-71e3d1713515 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.195308 Jun 16 17:47:03.071467 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 206/419] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:02 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:03.270865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:03.271514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:03.278145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:03.278599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.279997 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:03.280610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.325281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:03.326517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:03.333134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:03.333597 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.334371 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:03.334810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.469401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:03.476828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8885d737-15db-4853-aac7-5fb42b7104d3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.209746 Jun 16 17:47:03.477483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 214/420] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:03 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:03.483816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:03.484444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:03.491366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:03.491823 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.492643 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:03.493307 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:03.505670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:03.514184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c85ae2e9-a162-4629-956e-d092e1c47aef tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.192127 Jun 16 17:47:03.514874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 207/421] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:03 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:03.624356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:03.632436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:03.634160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:03.635317 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-66a4b152-4a19-44d7-8e36-aa29ec335369 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1723 microversion: 2.20 time: 0.155413 Jun 16 17:47:03.635867 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 215/422] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:03 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:04.088457 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:04.089233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:04.096144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:04.096641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:04.097432 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:04.097865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:04.493289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:04.493905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:04.501345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:04.501806 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:04.502582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:04.503023 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:04.820491 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:04.830254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e11fdca0-df5b-4bb7-b81f-61eefb177504 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.745542 Jun 16 17:47:04.830841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 208/423] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:04 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:04.835738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:04.836359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:04.842524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:04.842982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:04.843759 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:04.844207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:05.342166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:05.349525 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-21d1be4b-4180-4469-b2eb-7fb45fffb62e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.859998 Jun 16 17:47:05.360059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 216/424] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:04 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:05.360059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:05.360059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:05.361668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:05.362127 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:05.362895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:05.363334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:05.501227 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:05.508680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d7a5a5db-ba96-4e05-a312-2e630e9d159b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.676832 Jun 16 17:47:05.509743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 209/425] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:04 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:05.846215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:05.848242 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:05.849448 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:05.856181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:05.856435 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:05.857773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:05.858826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:05.859458 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:05.861175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:05.862587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3acbcf66-41a8-40b6-8104-63d8c06d6889 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1666 microversion: 2.20 time: 0.511568 Jun 16 17:47:05.863296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 217/426] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:05 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1666 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:05.881742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80b1d185-a78b-49a8-8968-7f24234a45bc"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:05.883081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:05.891637 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:05.892314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:05.893299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:05.893736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.286424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:06.297683 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-20f36f43-abb3-4131-8ce6-019f47af4301 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.453282 Jun 16 17:47:06.299074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 210/427] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:05 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:06.319877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:06.367037 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:06.367937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:06.379905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.380636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.382420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.383051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.442797 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-41b349a6-8745-4a0c-b4bf-61e8d7ab523e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.564985 Jun 16 17:47:06.446473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 218/428] 10.222.0.42 () {62 vars in 1363 bytes} [Thu Jun 16 17:47:05 2022] POST /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments => generated 188 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:47:06.526321 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:06.527208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:06.537537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.537995 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.538887 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.539187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.828093 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:06.835762 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-019fc4a3-4dd2-4365-91ec-544dbb240e96 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.472476 Jun 16 17:47:06.836350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 211/429] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:06 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:06.840705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-5193c3a1-8706-418d-8d90-33f99f279ca4 req-7b72ae54-ff61-45e0-9b4a-2409d3a0ca8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bcde2b0-d028-4892-bcfe-edcd9604daf8", "tag": "d7691eb5-1138-4f82-8f00-9de4dd6138dc"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:06.849557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-5193c3a1-8706-418d-8d90-33f99f279ca4 req-7b72ae54-ff61-45e0-9b4a-2409d3a0ca8b service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.850200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-5193c3a1-8706-418d-8d90-33f99f279ca4 req-7b72ae54-ff61-45e0-9b4a-2409d3a0ca8b service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.861600 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-5193c3a1-8706-418d-8d90-33f99f279ca4 req-7b72ae54-ff61-45e0-9b4a-2409d3a0ca8b service nova] Creating event network-changed:d7691eb5-1138-4f82-8f00-9de4dd6138dc for instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 on hv-cinder-83754 Jun 16 17:47:06.867034 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-5193c3a1-8706-418d-8d90-33f99f279ca4 req-7b72ae54-ff61-45e0-9b4a-2409d3a0ca8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029529 Jun 16 17:47:06.868244 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 212/430] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:06.873538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:06.874263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:06.880570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.881021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.882418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:06.882418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:06.907800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:06.957725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:06.969865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-62c8828d-216f-45db-b79c-a6f9015e83aa tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.447351 Jun 16 17:47:06.971116 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 219/431] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:06 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:07.037448 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d4560cd9-d08f-4d6e-98a0-a92c4f50db34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/action" status: 202 len: 0 microversion: 2.20 time: 0.168054 Jun 16 17:47:07.038272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 213/432] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jun 16 17:47:06 2022] POST /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:47:07.049510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:07.050227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:07.058363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:07.058807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:07.059777 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:07.061741 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:07.316122 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:07.316771 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:07.323150 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:07.323599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:07.324365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:07.324874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:07.864860 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:07.877137 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:07.878976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:07.880342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-05a09706-bd69-4d83-b4be-0e1f82a2efbc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1752 microversion: 2.20 time: 0.838051 Jun 16 17:47:07.881769 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 220/433] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:07 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1752 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:07.896343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:07.897101 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:07.904429 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:07.905196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:07.905866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:07.906402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:08.097975 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:08.109861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-211c1c14-1d83-4c42-9599-11ea7730b2f5 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.798098 Jun 16 17:47:08.111039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 214/434] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:07 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:08.124080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:08.125064 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:08.132367 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:08.133078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:08.134949 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:08.135618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:08.380109 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:08.389396 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8c880c22-5446-4236-936d-77b352109a64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.506420 Jun 16 17:47:08.390152 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 221/435] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:07 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:08.535399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:08.543505 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0270e2ee-2b82-4bcb-9d1b-f8215383c0a4 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.431174 Jun 16 17:47:08.545460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 215/436] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:08 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:08.886209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-a2e0173a-aa37-40eb-b4c9-8fe48eb48435 req-4e2503ed-6522-44b8-8204-c7a19c3896d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}, {"name": "network-changed", "server_uuid": "e2b4933f-b046-47e9-a9a4-573fc8b2051d", "tag": "b09e9e25-4da7-47ac-b372-5b64995be76e"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:08.896553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-a2e0173a-aa37-40eb-b4c9-8fe48eb48435 req-4e2503ed-6522-44b8-8204-c7a19c3896d4 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:08.896996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-a2e0173a-aa37-40eb-b4c9-8fe48eb48435 req-4e2503ed-6522-44b8-8204-c7a19c3896d4 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:08.899141 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:08.899756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:08.906684 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:08.907146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:08.907933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:08.908387 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:08.910019 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-a2e0173a-aa37-40eb-b4c9-8fe48eb48435 req-4e2503ed-6522-44b8-8204-c7a19c3896d4 service nova] Creating event network-changed:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:47:08.910522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-a2e0173a-aa37-40eb-b4c9-8fe48eb48435 req-4e2503ed-6522-44b8-8204-c7a19c3896d4 service nova] Creating event network-changed:b09e9e25-4da7-47ac-b372-5b64995be76e for instance e2b4933f-b046-47e9-a9a4-573fc8b2051d on hv-cinder-83754 Jun 16 17:47:08.916836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-a2e0173a-aa37-40eb-b4c9-8fe48eb48435 req-4e2503ed-6522-44b8-8204-c7a19c3896d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034535 Jun 16 17:47:08.917441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 222/437] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:09.044184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:09.052826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:09.054356 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:09.055520 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-32696401-f814-4dff-a211-b5fc84978597 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1754 microversion: 2.20 time: 0.160244 Jun 16 17:47:09.056139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 216/438] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:08 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:09.129293 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:09.129966 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:09.136592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:09.137046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:09.137814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:09.138886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:09.272100 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:09.280796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bd97e6c8-4a05-4024-b584-694843b8b5ca tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.155818 Jun 16 17:47:09.281362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 223/439] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:09 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:09.406353 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:09.406971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:09.413526 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:09.413980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:09.414754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:09.415200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:09.553993 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:09.562264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b0aa9de6-571f-44dc-b51a-7c2cbb15cfd9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.159875 Jun 16 17:47:09.562458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:09.562919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 217/440] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:09 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:09.563006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:09.569159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:09.569612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:09.570384 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:09.570822 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:09.741872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:09.752567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2ef5a09f-71cf-44b3-a841-e8052359466f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.194574 Jun 16 17:47:09.753156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 224/441] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:09 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:10.074937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:10.075546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:10.081601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.082047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.082805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.083239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.211217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:10.220078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:10.221605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:10.222743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8870da82-5c36-4b81-8d38-6d6a3e4d6a36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1754 microversion: 2.20 time: 0.151661 Jun 16 17:47:10.223293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 218/442] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:10 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:10.298125 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:10.298733 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:10.305303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.305699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.306464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.306897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.436770 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:10.444268 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f7ec423b-63e2-4ed9-9c5a-d5ecca7cb185 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.150615 Jun 16 17:47:10.444866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 225/443] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:10 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:10.579328 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:10.580457 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:10.587108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.587569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.588348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.588824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.720588 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:10.728266 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-614cd9e0-7f06-4eab-806d-47862a2f16ec tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.153340 Jun 16 17:47:10.729269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 219/444] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:10 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:10.770930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:10.772077 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:10.778477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.778928 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.779781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:10.780831 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:10.916770 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:10.924852 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-710ac83a-dcf0-4d57-83a4-ab12fef0cf35 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.157840 Jun 16 17:47:10.925417 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 226/445] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:10 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:11.242206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:11.242819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:11.249674 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.250131 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.250911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.251349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.382454 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:11.391594 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:11.393062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:11.394206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6be0f948-27f0-43c1-a8fd-c4abe16085a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1754 microversion: 2.20 time: 0.156006 Jun 16 17:47:11.394760 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 220/446] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:11 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:11.461503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:11.462105 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:11.468655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.469095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.469854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.470288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.600221 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:11.607630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3de7bab1-a85a-4082-9f57-4721ce5e3101 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.149935 Jun 16 17:47:11.608196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 227/447] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:11 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:11.745284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:11.745892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:11.752785 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.753229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.754015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.754429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.941581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:11.942191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:11.948440 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.948896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:11.949666 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:11.950104 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:12.005132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:12.013333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8edc6662-0a8c-4694-9024-fb1395bd1c8e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.272029 Jun 16 17:47:12.013990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 221/448] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:11 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:12.103639 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:12.112000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-088e2e87-6cbc-4160-8903-b656903a38f6 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.174314 Jun 16 17:47:12.112619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 228/449] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:11 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:12.412262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:12.412948 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:12.419389 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:12.419841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:12.421294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:12.421736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:12.626075 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:12.626852 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:12.634379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:12.635124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:12.635968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:12.636890 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:13.077209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:13.087085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:13.088631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:13.089951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-759e48bd-35bd-491b-b46e-c4b71b552e0b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.681781 Jun 16 17:47:13.090702 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 222/450] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:12 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:13.096423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:13.106805 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-74567151-42a0-4f76-a302-980d85b43125 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.485706 Jun 16 17:47:13.107601 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 229/451] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:12 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:13.113520 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-a7c0d450-0d0a-4193-bfde-224ecb868423 req-7ef802e1-47c4-4b44-adbb-1810407c0f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcde2b0-d028-4892-bcfe-edcd9604daf8", "name": "network-vif-plugged", "status": "completed", "tag": "d7691eb5-1138-4f82-8f00-9de4dd6138dc"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:13.118395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:13.127973 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:13.130526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:13.137303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:13.137762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:13.138535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:13.138970 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-a7c0d450-0d0a-4193-bfde-224ecb868423 req-7ef802e1-47c4-4b44-adbb-1810407c0f47 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:13.139911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:13.142065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-a7c0d450-0d0a-4193-bfde-224ecb868423 req-7ef802e1-47c4-4b44-adbb-1810407c0f47 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:13.163609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-a7c0d450-0d0a-4193-bfde-224ecb868423 req-7ef802e1-47c4-4b44-adbb-1810407c0f47 service nova] Creating event network-vif-plugged:d7691eb5-1138-4f82-8f00-9de4dd6138dc for instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 on hv-cinder-83754 Jun 16 17:47:13.169220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-a7c0d450-0d0a-4193-bfde-224ecb868423 req-7ef802e1-47c4-4b44-adbb-1810407c0f47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077188 Jun 16 17:47:13.170096 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 223/452] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:13.176830 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:13.177923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:13.184724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:13.185183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:13.186056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:13.186613 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:13.593782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:13.597377 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:13.601478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7e8648d6-e29d-486c-b3be-7eeb169c1b82 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.428784 Jun 16 17:47:13.602059 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 224/453] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:13 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:13.604951 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5fd28d46-c672-448d-a508-e77c1c06c503 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.495631 Jun 16 17:47:13.605675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 230/454] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:13 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:14.109942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:14.110559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:14.118142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.118832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.119625 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.120077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.126815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:14.127431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:14.136238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.136969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.137906 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.138489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.614268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:14.620437 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:14.626680 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:14.627897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:14.629986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f00b5d26-c39a-4bc6-bc97-f367bc500933 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.523748 Jun 16 17:47:14.640479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 225/455] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:14 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:14.640479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:14.640479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:14.643976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d57fa4f3-6f15-4f4b-905b-3d1d857e51ef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.521900 Jun 16 17:47:14.644870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 231/456] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:14 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:14.649359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:14.649966 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:14.656717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.656888 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.657172 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.657287 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.657946 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.658063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:14.658377 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.658498 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:14.891559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:14.899200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a3ac81f9-d103-450e-8921-cbb988d5c424 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.267174 Jun 16 17:47:14.908758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:14 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:14.938815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:14.947455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c476e98d-a846-4999-b140-4822becc82c0 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.301616 Jun 16 17:47:14.949274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 232/458] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:14 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:15.650928 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:15.652307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:15.662056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:15.662517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:15.663305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:15.663792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:15.663792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:15.664663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:15.673434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:15.673905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:15.675401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:15.681208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:15.888104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:15.901710 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:15.907098 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:15.911379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-86f3f91c-d755-4dad-bedb-7eb1942d9bf1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.264352 Jun 16 17:47:15.920784 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 227/459] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:15 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:15.924160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-bd59fe3b-f72a-4892-be0f-842309fd057d req-21f9ca7b-bd38-4d8d-a385-b3f53ffb4502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b4933f-b046-47e9-a9a4-573fc8b2051d", "name": "network-vif-plugged", "status": "completed", "tag": "b09e9e25-4da7-47ac-b372-5b64995be76e"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:15.942366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-bd59fe3b-f72a-4892-be0f-842309fd057d req-21f9ca7b-bd38-4d8d-a385-b3f53ffb4502 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:15.942925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-bd59fe3b-f72a-4892-be0f-842309fd057d req-21f9ca7b-bd38-4d8d-a385-b3f53ffb4502 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:15.978724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-bd59fe3b-f72a-4892-be0f-842309fd057d req-21f9ca7b-bd38-4d8d-a385-b3f53ffb4502 service nova] Creating event network-vif-plugged:b09e9e25-4da7-47ac-b372-5b64995be76e for instance e2b4933f-b046-47e9-a9a4-573fc8b2051d on hv-cinder-83754 Jun 16 17:47:15.979282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:15.989180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5e40a48c-282e-462f-a1a8-cbba3afc8b0b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.329888 Jun 16 17:47:15.989769 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 233/460] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:15 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:15.994524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:15.995136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:15.996241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-bd59fe3b-f72a-4892-be0f-842309fd057d req-21f9ca7b-bd38-4d8d-a385-b3f53ffb4502 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080543 Jun 16 17:47:15.997175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 228/461] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:16.003443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:16.003949 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:16.006224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:16.006941 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:16.009338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:16.009809 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:16.022420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:16.022877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:16.023669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:16.024113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:16.296363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:16.304739 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-97782fe3-8e01-49d7-bedb-a926ca95d143 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.306053 Jun 16 17:47:16.305316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 229/462] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:15 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:16.334980 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:16.342699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7229aa0c-f090-4e17-a749-207a1cbc67e2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.351746 Jun 16 17:47:16.343359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 234/463] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:15 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:16.932169 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:16.932943 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:16.941357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:16.941357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:16.942005 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:16.942444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:16.958762 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:17.006097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:17.006832 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:17.016828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:17.017646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:17.018664 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:17.019310 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:17.023808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SELECT=96 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:17.150982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:17.162336 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:17.162601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:17.163789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a13d51e7-f9c3-4a74-baab-030b8647eed6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.235548 Jun 16 17:47:17.174813 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 230/464] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:16 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:17.206041 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:17.218854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-331f2889-c790-4864-863d-0ced7598ebb8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.215719 Jun 16 17:47:17.219599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 235/465] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:17 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:17.322065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:17.322677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:17.329889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:17.330351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:17.331138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:17.331584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:17.359146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:17.359771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:17.376808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:17.377450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:17.378265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:17.378757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:17.540254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:17.550670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-77974f97-f660-4bdd-8345-045efca76738 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.232446 Jun 16 17:47:17.560621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 231/466] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:17 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:17.573266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:17.583513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-16a7c090-a3b0-446e-aabe-0758f02127af tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.227998 Jun 16 17:47:17.595061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 236/467] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:17 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:18.157857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-b0d80430-3231-4a61-b55f-9c4ea961d34f req-91cfb14a-8fb6-44c9-80d0-2f6884be23e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "name": "network-vif-plugged", "status": "completed", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:18.161851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:18.168104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b0d80430-3231-4a61-b55f-9c4ea961d34f req-91cfb14a-8fb6-44c9-80d0-2f6884be23e7 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.168588 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b0d80430-3231-4a61-b55f-9c4ea961d34f req-91cfb14a-8fb6-44c9-80d0-2f6884be23e7 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.181966 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-b0d80430-3231-4a61-b55f-9c4ea961d34f req-91cfb14a-8fb6-44c9-80d0-2f6884be23e7 service nova] Creating event network-vif-plugged:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:47:18.183326 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:18.183952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:18.187426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-b0d80430-3231-4a61-b55f-9c4ea961d34f req-91cfb14a-8fb6-44c9-80d0-2f6884be23e7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034103 Jun 16 17:47:18.188033 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 232/468] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:18.192191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.192880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.193667 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.194111 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.235563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:18.236319 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:18.243854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.244459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.248629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.250000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.401228 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:18.412160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:18.413984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:18.415408 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9ed840be-e473-4624-bdb6-62ae9dd81b65 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.236792 Jun 16 17:47:18.426020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 237/469] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:18 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:18.430640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:18.439316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8d9c93bd-22d3-4c08-bebd-2221196b284c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.207930 Jun 16 17:47:18.439898 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 233/470] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:18 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:18.568452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:18.569279 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:18.580673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.581136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.581929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.582366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.602753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:18.603706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:18.612263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.613011 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.614374 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:18.615061 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:18.800420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:18.808242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3e3b6203-a135-4abe-845f-f01fc53f80e3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.244078 Jun 16 17:47:18.812956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 238/471] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:18 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:18.829845 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:18.837571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-111bfe19-7719-4746-8666-c884fde0e5c2 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.239606 Jun 16 17:47:18.838358 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 234/472] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:18 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:19.434159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:19.434819 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:19.441793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.442245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.443023 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.443466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.457926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:19.458636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:19.467516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.468533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.469388 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.469826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.683414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:19.687174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:19.695089 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a6dcd965-399f-43dc-a14f-d74dd479e56e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.241652 Jun 16 17:47:19.696231 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:19.697846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:19.699185 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cc147c9e-f42a-4662-8a5e-aa41470c9860 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.268944 Jun 16 17:47:19.703274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 239/473] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:19 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:19.704576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 235/474] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:19 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:19.824693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:19.825301 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:19.831866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.832312 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.833106 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.833542 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.855073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:19.856086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:19.871293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.871850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:19.872742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:19.873261 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:20.039900 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:20.049669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-99a9b18c-d7a5-41d9-84cc-446b0f364fa9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.228683 Jun 16 17:47:20.050616 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 240/475] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:19 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:20.079472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:20.087652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ea085908-1755-4895-b622-bf6b621b2734 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.236416 Jun 16 17:47:20.088636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 236/476] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:19 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:20.711910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:20.712699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:20.718632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:20.719237 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:20.719974 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:20.720468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:20.721249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:20.721686 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:20.727255 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:20.727255 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:20.727657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:20.728087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:20.948671 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:20.956788 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-94a3584f-d949-4300-b03b-5319108cce2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.248596 Jun 16 17:47:20.957694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 241/477] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:20 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:20.974630 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:20.985619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:20.987138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:20.988306 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f417737b-01e1-4290-9ae3-aeff9f03ffba tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.274328 Jun 16 17:47:20.988897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:20 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:21.066718 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:21.067323 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:21.073370 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:21.073818 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:21.074583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:21.075016 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:21.105655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:21.106262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:21.113887 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:21.114370 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:21.115113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:21.115543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:21.299747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:21.309333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f963e6da-081c-4d74-81a2-5d6d991ce5d4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.246320 Jun 16 17:47:21.310096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 242/479] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:21 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:21.323096 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:21.336693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-19358bc6-ef92-4412-a2da-354d468e1288 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.234645 Jun 16 17:47:21.340417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 238/480] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:21 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:21.974455 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:21.975105 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:21.981195 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:21.981651 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:21.982431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:21.983247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.007082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:22.007717 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:22.015468 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:22.015931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.016754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:22.017190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.197001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:22.206215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1d498507-a137-4af4-bc8b-752cea815021 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.235664 Jun 16 17:47:22.206905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 243/481] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:21 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:22.220495 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:22.235646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:22.237279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:22.238538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e77f2c0c-fb9c-4a73-85ab-e1d4203e5dca tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.235362 Jun 16 17:47:22.239318 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 239/482] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:22 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:22.327804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:22.328439 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:22.334648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:22.335106 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.335881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:22.336328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.353074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:22.353777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:22.359932 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:22.360557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.361434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:22.361937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:22.578354 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:22.586572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-221dfb5b-13e9-4b8b-b5b3-a0334a6da89f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.263095 Jun 16 17:47:22.587537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 244/483] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:22 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:22.590863 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:22.603217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f39095a0-e21e-458c-a864-50b4110f6234 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.253927 Jun 16 17:47:22.605020 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 240/484] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:22 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:23.223017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:23.223621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:23.230289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.230747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.231522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.231963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.257171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:23.257783 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:23.264748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.265202 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.265987 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.266430 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.438187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:23.445784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2cbd9270-e58f-4369-9265-930e6335daf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1366 microversion: 2.1 time: 0.226550 Jun 16 17:47:23.446368 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 245/485] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:23 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:23.461743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:23.470642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:23.472138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:23.473363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-01894e04-04a3-434d-a150-0f4c75dbb698 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.220029 Jun 16 17:47:23.473858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 241/486] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:23 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:23.604030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:23.604675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:23.611738 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.612185 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.612967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.613404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.619572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:23.620189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:23.626335 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.626790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.627568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:23.628010 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:23.907483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:23.911776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:23.915229 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0be6848c-1e81-40f0-aead-d01424b9b516 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.314981 Jun 16 17:47:23.915803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 246/487] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:23 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:23.919346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-398ee353-7e4d-456a-9607-42f0fb12afcb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.303540 Jun 16 17:47:23.919974 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 242/488] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:23 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:24.462936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:24.463595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:24.471171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.471629 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.472418 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.472861 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.491975 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:24.492928 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:24.500115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.500760 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.501652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.502200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.776445 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:24.781058 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:24.785782 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4b29b76e-2e97-421f-a540-44ef0938ea1e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1555 microversion: 2.1 time: 0.326672 Jun 16 17:47:24.786885 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 247/489] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:24 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:24.791465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:24.793024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:24.794463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9f744586-9329-4f9c-8b2e-f7359553ec97 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.306140 Jun 16 17:47:24.803430 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:24.804283 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:24.805760 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 243/490] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:24 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:24.810939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.811524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.812348 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.812885 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.892631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7ac18ab8-e998-4027-b8e7-e61012fb62b9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093931 Jun 16 17:47:24.893226 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 248/491] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:47:24 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:24.932529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:24.933150 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:24.936191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:24.937208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:24.940510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.940634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.941549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.942248 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.944353 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.944866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:24.945648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:24.946093 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:25.282509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:25.290081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4eb5b14a-c75c-47b4-b8cc-8a167b5b4f7d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.357831 Jun 16 17:47:25.290655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 249/492] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:24 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:25.292226 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:25.301323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c6209e74-0a3b-4d73-a1da-4cb161d5a93c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.372984 Jun 16 17:47:25.302027 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 244/493] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:24 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:25.813610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:25.814261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:25.821124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:25.821567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:25.822322 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:25.822758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:26.101555 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:26.110516 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:26.112035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:26.113249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f6e73780-7f83-429d-9822-1f6a953ed3fc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.304394 Jun 16 17:47:26.113810 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 250/494] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:25 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:26.307145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:26.307604 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:26.314292 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:26.314750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:26.315536 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:26.315976 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:26.318718 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:26.319481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:26.325919 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:26.327076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:26.328630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:26.329175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:26.605943 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:26.613743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-25a8c5c6-2c69-4d29-b02e-6d0e91493268 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1357 microversion: 2.1 time: 0.310620 Jun 16 17:47:26.614317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 245/495] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:26 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1357 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:26.621305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:26.629224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-0949861d-17a6-493d-892e-751809544cee req-5227bef0-0a45-472b-b23e-885e330704bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bcde2b0-d028-4892-bcfe-edcd9604daf8", "tag": "d7691eb5-1138-4f82-8f00-9de4dd6138dc"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:26.629805 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-01b63708-2e45-4b8c-aa8c-25a989abca6f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1371 microversion: 2.1 time: 0.315356 Jun 16 17:47:26.630535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 251/496] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:26 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:26.637688 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-0949861d-17a6-493d-892e-751809544cee req-5227bef0-0a45-472b-b23e-885e330704bd service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:26.638196 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-0949861d-17a6-493d-892e-751809544cee req-5227bef0-0a45-472b-b23e-885e330704bd service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:26.650938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-0949861d-17a6-493d-892e-751809544cee req-5227bef0-0a45-472b-b23e-885e330704bd service nova] Creating event network-changed:d7691eb5-1138-4f82-8f00-9de4dd6138dc for instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 on hv-cinder-83754 Jun 16 17:47:26.655963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-0949861d-17a6-493d-892e-751809544cee req-5227bef0-0a45-472b-b23e-885e330704bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030302 Jun 16 17:47:26.656599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 246/497] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:27.131141 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:27.131854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:27.139744 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.140133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.140936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.141377 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.145470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:27.277011 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:27.286416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:27.287961 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:27.289231 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0ee94675-3285-458d-8e98-46260062c21a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.162068 Jun 16 17:47:27.290159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 252/498] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:27 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:27.631583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:27.632517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:27.642146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.642625 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.644090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.644584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.647287 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:27.647906 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:27.654216 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.654673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.655447 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.655887 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.853265 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:27.856040 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:27.862125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ae8beb40-bb6f-428c-8995-a4850570ecb7 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1547 microversion: 2.1 time: 0.234898 Jun 16 17:47:27.862955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 247/499] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:27 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1547 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:27.865140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-da71bfcd-e0be-4fb4-9c1a-3edf0b18b260 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1565 microversion: 2.1 time: 0.221921 Jun 16 17:47:27.865976 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 253/500] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:27 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1565 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:27.879353 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:27.879962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:27.882436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:27.882941 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:27.886422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.886875 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.887859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.888065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.890199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.890652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.891429 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:27.891872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:27.903819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:28.000159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c69344e1-ded2-4d34-b046-4feaf41e9772 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121271 Jun 16 17:47:28.000781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 254/501] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:47:27 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:47:28.244209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:28.252361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b97604d2-605c-4792-9d5b-186d4d4bad2d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1547 microversion: 2.1 time: 0.376652 Jun 16 17:47:28.252895 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 248/502] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:27 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1547 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:28.269388 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:28.273473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:28.274254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Searching by: {'deleted': False, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84'} {{(pid=124157) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 17:47:28.282008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:28.282468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:28.283269 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:28.283710 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:28.307023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:28.307877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:28.314883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:28.315423 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:28.316299 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:28.317000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:28.376673 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.multi_cell_list [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124157) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 17:47:28.495562 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c8fc620a-de8f-4fe3-bb3b-4bd529c1d6b1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.231061 Jun 16 17:47:28.496154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 255/503] 10.222.0.42 () {58 vars in 1124 bytes} [Thu Jun 16 17:47:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:28.507128 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:28.507655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:28.514389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:28.514831 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:28.515717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:28.516159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:28.949170 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:28.951797 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:28.957473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-85bca430-f489-420d-9790-7a9c7aa55437 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1547 microversion: 2.1 time: 0.454281 Jun 16 17:47:28.969424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 256/504] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:28 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1547 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:28.969627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:28.969627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:28.969627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-61d24e51-632b-4ee7-9f15-471386ed1f3d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.660569 Jun 16 17:47:28.969938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 249/505] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:28 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:29.772247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-66463ca0-d65b-41e5-8708-7c37aebb09ea req-86ea359a-607f-498b-8c73-87334c823d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b4933f-b046-47e9-a9a4-573fc8b2051d", "tag": "b09e9e25-4da7-47ac-b372-5b64995be76e"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:29.781030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-66463ca0-d65b-41e5-8708-7c37aebb09ea req-86ea359a-607f-498b-8c73-87334c823d02 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:29.781483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-66463ca0-d65b-41e5-8708-7c37aebb09ea req-86ea359a-607f-498b-8c73-87334c823d02 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:29.792427 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-66463ca0-d65b-41e5-8708-7c37aebb09ea req-86ea359a-607f-498b-8c73-87334c823d02 service nova] Creating event network-changed:b09e9e25-4da7-47ac-b372-5b64995be76e for instance e2b4933f-b046-47e9-a9a4-573fc8b2051d on hv-cinder-83754 Jun 16 17:47:29.797738 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-66463ca0-d65b-41e5-8708-7c37aebb09ea req-86ea359a-607f-498b-8c73-87334c823d02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029094 Jun 16 17:47:29.798341 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 257/506] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:29.983841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:29.984535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:29.991218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:29.991685 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:29.992493 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:29.992938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:30.129851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:30.138673 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:30.140392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:30.141560 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-38b18dea-bd13-4a94-852d-46cf4f2a0e9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.162456 Jun 16 17:47:30.142115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 250/507] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:29 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:30.483755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224aa8a4-b494-4f3d-88d8-c10f288bc0e5"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:30.485068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:30.491367 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:30.491828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:30.492636 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:30.493079 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:31.162351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:31.164969 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:31.180631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:31.181093 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:31.181894 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:31.182519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:31.203553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-56ecb8e8-40ad-498a-ab9a-670a534081eb tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724933 Jun 16 17:47:31.204715 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 258/508] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:47:30 2022] POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments => generated 194 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:31.363988 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:31.372414 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:31.374718 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:31.375869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-877f5b6d-cea4-4c7a-9be8-7b50f4d27c34 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.219521 Jun 16 17:47:31.376704 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 251/509] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:31 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:32.396097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:32.396745 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:32.403424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:32.403870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:32.404674 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:32.405105 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:32.542898 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:32.552157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:32.553668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:32.554809 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e0712d98-5d9d-45d1-8d79-ab3b56fb07e5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.163044 Jun 16 17:47:32.555364 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 259/510] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:32 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:33.572821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:33.573434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:33.584635 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:33.585095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:33.585865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:33.586299 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:33.720397 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:33.728964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:33.730473 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:33.731623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cb477d7b-3d97-4c8f-903b-206fe1b37599 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.162709 Jun 16 17:47:33.732182 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 252/511] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:33 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:34.131325 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:34.131813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:34.138716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:34.139171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:34.139978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:34.140536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:34.283646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lazy-loading 'services' on Instance uuid 6228596e-39a4-457c-bdad-6fb60dc046f6 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:47:34.398200 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-83acd741-d80a-4b26-82f3-86c6047a3bb3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-volume_attachments/ac9f2596-e92b-46b1-add8-3e2a45a43815" status: 202 len: 0 microversion: 2.1 time: 0.270670 Jun 16 17:47:34.398871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 260/512] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:47:34 2022] DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-volume_attachments/ac9f2596-e92b-46b1-add8-3e2a45a43815 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:47:34.751014 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:34.751637 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:34.758171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:34.758626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:34.759656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:34.760099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:34.895490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:34.904050 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:34.905612 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:34.907449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-32225024-0743-4591-bb8c-8165e817cdac tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.160800 Jun 16 17:47:34.908024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 253/513] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:34 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:34.972310 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-ccb60858-d444-46bb-948a-410e6c2f5a25 req-c61a041c-5bb1-45b7-8c6c-3bb6c8624cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "name": "network-vif-plugged", "status": "completed", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:34.980815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-ccb60858-d444-46bb-948a-410e6c2f5a25 req-c61a041c-5bb1-45b7-8c6c-3bb6c8624cff service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:34.981269 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-ccb60858-d444-46bb-948a-410e6c2f5a25 req-c61a041c-5bb1-45b7-8c6c-3bb6c8624cff service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:34.993350 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-ccb60858-d444-46bb-948a-410e6c2f5a25 req-c61a041c-5bb1-45b7-8c6c-3bb6c8624cff service nova] Creating event network-vif-plugged:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:47:34.998123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-ccb60858-d444-46bb-948a-410e6c2f5a25 req-c61a041c-5bb1-45b7-8c6c-3bb6c8624cff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030884 Jun 16 17:47:34.998781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 261/514] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:35.926077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:35.926691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:35.933279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:35.933730 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:35.934498 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:35.934935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:36.060779 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:36.070154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:36.071675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:36.072872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9d8f8bec-c08b-4920-bc77-610a8e2dac06 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.151179 Jun 16 17:47:36.073433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 254/515] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:35 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:37.092731 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:37.093431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:37.100684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:37.101135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:37.101898 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:37.102338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:37.237533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:37.246065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:37.247625 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:37.248799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cb1af470-c531-4120-9c5d-8ceedb2fc887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.160845 Jun 16 17:47:37.249366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 262/516] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:37 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:38.267589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:38.268210 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:38.275868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:38.275868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:38.277407 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:38.277843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:38.428400 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:38.437430 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:38.440175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:38.441618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-32910f84-f067-4c7d-a6e2-45052b2e40ef tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1810 microversion: 2.20 time: 0.178488 Jun 16 17:47:38.442216 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 255/517] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:38 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:47:39.462699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:39.463310 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:39.465768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:39.472099 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:39.472583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:39.473359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:39.473780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:39.608163 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:39.616859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:39.618343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:39.619489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2e87696b-1ceb-4469-804a-fe8d9c19eafd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1797 microversion: 2.20 time: 0.160656 Jun 16 17:47:39.620031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 263/518] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:47:39 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1797 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:47:39.831172 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:39.831795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:39.838366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:39.838826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:39.839604 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:39.840054 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:39.984200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:39.993205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5ee6ff33-09d1-4193-b0bd-9847c1f46805 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1593 microversion: 2.1 time: 0.167194 Jun 16 17:47:39.993768 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 256/519] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:39 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1593 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:40.803412 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-28919263-8378-45fe-9458-cb14abbc650f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:40.811799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-28919263-8378-45fe-9458-cb14abbc650f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:40.812262 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-28919263-8378-45fe-9458-cb14abbc650f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:40.878329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-28919263-8378-45fe-9458-cb14abbc650f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Going to try to stop instance {{(pid=124157) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 17:47:40.932964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-28919263-8378-45fe-9458-cb14abbc650f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action" status: 202 len: 0 microversion: 2.1 time: 0.133236 Jun 16 17:47:40.933570 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 264/520] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:47:40 2022] POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:47:40.947972 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:40.948716 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:40.956960 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:40.957525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:40.958640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:40.959197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:41.422337 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:41.430399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9f85923d-790b-41c9-bca5-97b79c214720 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.492582 Jun 16 17:47:41.430988 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 257/521] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:40 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:42.043682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-0627359d-8bf2-4fb9-995d-2396d1787e0f req-dc50fb20-0fac-4f16-bfbb-87e318e9eb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:42.052113 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-0627359d-8bf2-4fb9-995d-2396d1787e0f req-dc50fb20-0fac-4f16-bfbb-87e318e9eb17 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:42.052685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-0627359d-8bf2-4fb9-995d-2396d1787e0f req-dc50fb20-0fac-4f16-bfbb-87e318e9eb17 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:42.064428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-0627359d-8bf2-4fb9-995d-2396d1787e0f req-dc50fb20-0fac-4f16-bfbb-87e318e9eb17 service nova] Creating event network-changed:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:47:42.069379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-0627359d-8bf2-4fb9-995d-2396d1787e0f req-dc50fb20-0fac-4f16-bfbb-87e318e9eb17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030511 Jun 16 17:47:42.069965 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 265/522] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:47:42.452714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:42.453557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:42.462658 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:42.463704 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:42.465359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:42.465820 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:42.726650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:42.736342 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0861ee94-bdf4-4859-ba5f-f71b9de50305 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.289472 Jun 16 17:47:42.737791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 258/523] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:42 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:43.359721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-610801139"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:43.360922 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:43.362853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=72 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:43.368477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:43.368929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:43.369699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:43.370138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:43.506053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.network.security_group_api [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Adding security group 3acd422d-5395-4af9-aade-8cb93b30c262 to port 6c162a6a-4074-4e87-ad30-96c62f1c9169 Jun 16 17:47:43.756061 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:43.757099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:43.764138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:43.764731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:43.765519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:43.765963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:43.911259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d5a527cf-00c8-4008-986d-4bc5168895c1 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/action" status: 202 len: 0 microversion: 2.1 time: 0.556291 Jun 16 17:47:43.915757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 266/524] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:47:43 2022] POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:47:43.920993 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:43.921690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:43.928634 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:43.929188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:43.930046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:43.930693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:44.030060 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:44.040343 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c599ff79-6f64-45ab-b803-bd52d3d496b0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.289143 Jun 16 17:47:44.041748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 259/525] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:43 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:47:44.086558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-b0e548c5-615b-4c20-b8e7-471871621abe req-0cf0d04c-862e-4c00-8826-a9e578e8caaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:44.097207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b0e548c5-615b-4c20-b8e7-471871621abe req-0cf0d04c-862e-4c00-8826-a9e578e8caaa service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:44.097907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b0e548c5-615b-4c20-b8e7-471871621abe req-0cf0d04c-862e-4c00-8826-a9e578e8caaa service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:44.111379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-b0e548c5-615b-4c20-b8e7-471871621abe req-0cf0d04c-862e-4c00-8826-a9e578e8caaa service nova] Creating event network-changed:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:47:44.119151 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-b0e548c5-615b-4c20-b8e7-471871621abe req-0cf0d04c-862e-4c00-8826-a9e578e8caaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035764 Jun 16 17:47:44.120468 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 260/526] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:47:44.125343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:44.134775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1b095317-2429-42b2-ba37-24cdeaddc26d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1758 microversion: 2.1 time: 0.217659 Jun 16 17:47:44.135359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 267/527] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:43 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:45.059025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:45.059728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:45.066980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:45.067435 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:45.068204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:45.068675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:45.197945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:45.206390 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7356dfc1-a294-4b0f-9347-60d240821216 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.151520 Jun 16 17:47:45.206966 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 261/528] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:45 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:46.224619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:46.225235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:46.231717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:46.232169 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:46.232965 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:46.233403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:46.235925 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:46.367414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:46.374947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c8ef4033-dc06-4273-a240-ec64eac47530 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.155813 Jun 16 17:47:46.375508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 268/529] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:46 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:47.394163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:47.394767 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:47.401465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:47.401924 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:47.402703 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:47.403148 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:47.530934 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:47.538672 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5872e9ff-84b4-4cae-8409-3993311eceff tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.148833 Jun 16 17:47:47.539278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 262/530] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:47 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:48.555846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:48.556469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:48.562888 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:48.563335 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:48.564086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:48.565216 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:48.696735 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:48.704211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-91e3fcd7-f727-4db0-9808-35a8869b7ed7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.152227 Jun 16 17:47:48.705017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 269/531] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:48 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:49.722486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:49.723639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:49.726911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=62 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:49.732956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:49.733415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:49.734191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:49.734632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:49.866863 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:49.874627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-61c22d6b-2875-4df0-8481-bebe988d07a8 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.157137 Jun 16 17:47:49.875209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 263/532] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:49 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:50.896138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:50.897210 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:50.905595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:50.906054 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:50.906824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:50.907270 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:51.038458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:51.045923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-fe75803b-69ac-4267-915d-252400ffd631 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1677 microversion: 2.1 time: 0.156347 Jun 16 17:47:51.046487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 270/533] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:50 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:52.063233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:52.063850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:52.070470 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:52.070926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:52.071699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:52.072143 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:52.243983 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:52.251547 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2ed0819b-9019-45ee-8f16-cb64c9b25994 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1654 microversion: 2.1 time: 0.192305 Jun 16 17:47:52.252728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 264/534] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:52 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1654 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:52.269956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b10f92b7-56ca-4f2c-a4e1-ca110cf0b240 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:47:52.277281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b10f92b7-56ca-4f2c-a4e1-ca110cf0b240 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:52.277700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b10f92b7-56ca-4f2c-a4e1-ca110cf0b240 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:52.301266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b10f92b7-56ca-4f2c-a4e1-ca110cf0b240 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Going to try to start instance {{(pid=124157) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 17:47:52.344911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b10f92b7-56ca-4f2c-a4e1-ca110cf0b240 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action" status: 202 len: 0 microversion: 2.1 time: 0.079504 Jun 16 17:47:52.345551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 271/535] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:47:52 2022] POST /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:47:52.353957 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:52.354572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:52.360690 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:52.361475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:52.362246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:52.362693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:52.575599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:52.577845 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:52.585099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b7d05b40-8c1b-4fa5-a09a-d51b8937cdba tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1663 microversion: 2.1 time: 0.234935 Jun 16 17:47:52.585679 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 265/536] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:52 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1663 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:53.603795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:53.604538 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:53.611211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:53.611652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:53.612487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:53.612935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:53.864499 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:53.872140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-12d5214d-91f9-4ccb-a21a-4478252d0475 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1663 microversion: 2.1 time: 0.273251 Jun 16 17:47:53.872748 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 272/537] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:53 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1663 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:54.890663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:54.891273 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:54.898144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:54.898587 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:54.899346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:54.899777 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:55.031215 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:55.042772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-877abec2-aa0b-4aee-bc38-57d45ebaf5f4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1663 microversion: 2.1 time: 0.155716 Jun 16 17:47:55.043649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 266/538] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:54 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:47:56.062189 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:47:56.062804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:47:56.070019 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:56.070473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:56.071239 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:47:56.071679 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:47:56.201278 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:47:56.209355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b4959c55-1716-4a55-894f-91bc1941b0de tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1667 microversion: 2.1 time: 0.151077 Jun 16 17:47:56.209923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 273/539] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:47:56 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:10.175935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:10.176499 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:10.178554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=7 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:10.179239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=7 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:10.185233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.185693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.186465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.186906 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.210044 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d1f437d1-f9d8-482d-864f-23c9686091bf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/ips" status: 200 len: 149 microversion: 2.1 time: 0.038933 Jun 16 17:48:10.210619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 267/540] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:48:10 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:10.221547 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b63586c-8d29-4c1c-b540-95560930707d"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:10.222683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:10.225325 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=15 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:10.225990 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:10.231778 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.232229 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.233030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.233470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.313513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Invalid volume: volume 2b63586c-8d29-4c1c-b540-95560930707d is already attached to instances: dc1a3f32-7aab-4b92-81cf-74a18b529bff Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: POST /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/os-volume_attachments HTTP/1.1 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 74 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:48:10.316082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {"volumeAttachment": {"volumeId": "2b63586c-8d29-4c1c-b540-95560930707d"}} Jun 16 17:48:10.317603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Invalid volume: volume 2b63586c-8d29-4c1c-b540-95560930707d is already attached to instances: dc1a3f32-7aab-4b92-81cf-74a18b529bff Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'server_id': '3bcde2b0-d028-4892-bcfe-edcd9604daf8', 'body': {'volumeAttachment': {'volumeId': '2b63586c-8d29-4c1c-b540-95560930707d'}}} Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b63586c-8d29-4c1c-b540-95560930707d is already attached to instances: dc1a3f32-7aab-4b92-81cf-74a18b529bff Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:10.318379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b63586c-8d29-4c1c-b540-95560930707d is already attached to instances: dc1a3f32-7aab-4b92-81cf-74a18b529bff Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:10.319632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b63586c-8d29-4c1c-b540-95560930707d is already attached to instances: dc1a3f32-7aab-4b92-81cf-74a18b529bff Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 400 to user: Invalid volume: volume 2b63586c-8d29-4c1c-b540-95560930707d is already attached to instances: dc1a3f32-7aab-4b92-81cf-74a18b529bff {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-71f4e3de-c175-48a5-9411-907d77bda476 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100605 Jun 16 17:48:10.320826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 274/541] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:48:10 2022] POST /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:48:10.326291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:10.326799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:10.334825 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.335282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.336057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.336535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.361217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:48:10.435031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f26a86bd-1d45-4f03-bb76-bf53a099ba41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 204 len: 0 microversion: 2.1 time: 0.112140 Jun 16 17:48:10.435587 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 268/542] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:48:10 2022] DELETE /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:48:10.444536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:10.445254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:10.453576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.454048 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.454835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:10.456104 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:10.589466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:10.597499 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c56dedf6-1604-4720-be34-6324526fa3bd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1680 microversion: 2.1 time: 0.157252 Jun 16 17:48:10.598057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 275/543] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:10 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:11.616125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:11.616857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:11.623345 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:11.623800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:11.624610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:11.625055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:11.753476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:11.761270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d0ac5466-1a02-4379-b658-8c438535771f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1680 microversion: 2.1 time: 0.150184 Jun 16 17:48:11.761832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 269/544] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:11 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:12.779007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:12.779567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:12.786371 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:12.786831 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:12.787611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:12.788058 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:12.995700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:13.003192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6d1b46b3-9481-44ad-b346-6837b657ecb7 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1680 microversion: 2.1 time: 0.228133 Jun 16 17:48:13.004082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 276/545] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:12 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:13.366326 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-cab34a9b-eb39-4d7a-aaf3-09f557a3baa5 req-cf3d133d-7851-4ae0-8b2f-d1c9d1ab8d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcde2b0-d028-4892-bcfe-edcd9604daf8", "name": "network-vif-deleted", "tag": "d7691eb5-1138-4f82-8f00-9de4dd6138dc"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:13.375636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-cab34a9b-eb39-4d7a-aaf3-09f557a3baa5 req-cf3d133d-7851-4ae0-8b2f-d1c9d1ab8d9c service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:13.376086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-cab34a9b-eb39-4d7a-aaf3-09f557a3baa5 req-cf3d133d-7851-4ae0-8b2f-d1c9d1ab8d9c service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:13.389235 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-cab34a9b-eb39-4d7a-aaf3-09f557a3baa5 req-cf3d133d-7851-4ae0-8b2f-d1c9d1ab8d9c service nova] Creating event network-vif-deleted:d7691eb5-1138-4f82-8f00-9de4dd6138dc for instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 on hv-cinder-83754 Jun 16 17:48:13.394679 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-cab34a9b-eb39-4d7a-aaf3-09f557a3baa5 req-cf3d133d-7851-4ae0-8b2f-d1c9d1ab8d9c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033096 Jun 16 17:48:13.398241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 270/546] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:14.022034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:14.022878 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:14.029460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:14.030001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:14.030853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:14.031494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:14.068013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:14.068808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:14.069509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lazy-loading 'fault' on Instance uuid 3bcde2b0-d028-4892-bcfe-edcd9604daf8 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:48:14.117472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:14.124541 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-97dd3bb3-cb95-4735-9b30-37298621d978 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 200 len: 1330 microversion: 2.1 time: 0.107514 Jun 16 17:48:14.125112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 277/547] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:14 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:15.144329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:15.145000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:15.151365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:15.151826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:15.152629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:15.153082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:15.167516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 HTTP/1.1 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:48:15.169230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:48:15.170535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '3bcde2b0-d028-4892-bcfe-edcd9604daf8'} Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:48:15.171253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:48:15.176772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:15.178224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:48:15.178224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4414a7f7-9040-442b-b85d-4af6e55bac08 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 404 len: 111 microversion: 2.1 time: 0.031291 Jun 16 17:48:15.178224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 271/548] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:15 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:48:15.180533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b7e2a8df-2eba-4224-a2ba-b6d3f963f183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '.version_select at 0x7f288c0649d0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:15.200826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b7e2a8df-2eba-4224-a2ba-b6d3f963f183 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379238914" status: 202 len: 0 microversion: 2.1 time: 0.024170 Jun 16 17:48:15.201522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 278/549] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jun 16 17:48:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379238914 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:48:15.862439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:15.862944 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:15.870626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:15.871458 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:15.872614 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:15.873067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:16.008646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lazy-loading 'services' on Instance uuid dc1a3f32-7aab-4b92-81cf-74a18b529bff {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:48:16.128758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0a262e78-c887-4a48-83ba-6438c066541d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments/2b63586c-8d29-4c1c-b540-95560930707d" status: 202 len: 0 microversion: 2.1 time: 0.270355 Jun 16 17:48:16.129339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 272/550] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:48:15 2022] DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments/2b63586c-8d29-4c1c-b540-95560930707d => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:48:16.138156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:16.139124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:16.147371 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:16.147900 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:16.150061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:16.150561 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:16.187967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-07518e5d-35ba-45b4-aa1c-d99d4c9be927 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054050 Jun 16 17:48:16.188654 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 279/551] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:48:16 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:16.513173 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7492fc79-0643-4ebf-8546-35012e5b43d4"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:16.514284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:16.521585 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:16.522045 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:16.522817 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:16.523259 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:16.952831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-364d164f-308c-415e-81fa-368b58ddb29e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444146 Jun 16 17:48:16.953462 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 273/552] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:48:16 2022] POST /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:17.200584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:17.201555 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:17.208999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:17.209463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:17.210241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:17.210717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:17.240089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d46602e5-3a3e-4a36-b7d4-671375badf29 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Jun 16 17:48:17.240861 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 280/553] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:48:17 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:17.536489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:17.537551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:17.543972 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:17.544495 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:17.545310 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:17.545749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:17.619614 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b9a2431c-6bf0-4c09-a4e6-0bc3a12e38ae tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/action" status: 202 len: 0 microversion: 2.1 time: 0.087666 Jun 16 17:48:17.623137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 274/554] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:48:17 2022] POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:48:17.629554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:17.630224 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:17.636448 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:17.637441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:17.638316 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:17.639241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:17.844355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:17.853005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1495ca2e-1270-4e95-a15e-56d8e3ee545c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1750 microversion: 2.1 time: 0.228572 Jun 16 17:48:17.853576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 281/555] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:17 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:18.252478 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:18.253514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:18.260559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.261018 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.261797 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.262236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.294634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0c328210-2453-457f-90a9-59ad7557573f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046731 Jun 16 17:48:18.295197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 275/556] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:48:18 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:48:18.353767 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:18.354257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:18.360746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.362394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.363161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.363617 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.388643 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:48:18.477133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-03f0dc11-b149-4a89-a2f8-c6594e2ca69c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 204 len: 0 microversion: 2.1 time: 0.126947 Jun 16 17:48:18.477716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 282/557] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:48:18 2022] DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:48:18.485553 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:18.486882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:18.493171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.493832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.494793 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.495225 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.628236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:18.635972 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2a6b20dd-8fcc-4948-8224-b7aca9bf07eb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1681 microversion: 2.1 time: 0.154150 Jun 16 17:48:18.636549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 276/558] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:18 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:18.871746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:18.872388 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:18.878562 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.879009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:18.879769 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:18.880206 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:19.029201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:19.037288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3cc83946-7276-4bf0-826d-d8c20e5d033f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.169817 Jun 16 17:48:19.037855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 283/559] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:18 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:19.653532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:19.654141 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:19.661859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:19.662347 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:19.663117 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:19.663552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:19.795067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:19.802616 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-289ecdc7-0ead-4320-a531-a0700ef26362 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1681 microversion: 2.1 time: 0.152983 Jun 16 17:48:19.803167 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 277/560] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:19 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:20.054971 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:20.055591 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:20.062094 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:20.062540 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:20.063311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:20.063750 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:20.222903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:20.231144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-74353f53-9ab0-40ff-985b-7c36203fad93 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.180145 Jun 16 17:48:20.231711 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 284/561] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:20 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:20.820346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:20.821004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:20.827552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:20.828001 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:20.828791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:20.829231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:21.046694 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:21.055132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6e5ed301-f037-4e99-930d-7538a17c624f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1681 microversion: 2.1 time: 0.238451 Jun 16 17:48:21.055773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 278/562] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:20 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:21.249279 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:21.249903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:21.256787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:21.257238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:21.258113 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:21.258461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:21.482555 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:21.494395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7dc59535-6a2d-47a3-a15c-96946b6fa669 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.248892 Jun 16 17:48:21.495297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 285/563] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:21 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:21.995029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-75123bca-fab3-4e2d-a957-fe45235670c9 req-16a3c9ea-fc87-4e7b-8a97-9c18a751b578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1a3f32-7aab-4b92-81cf-74a18b529bff", "name": "network-vif-deleted", "tag": "2efcc93f-177c-4f73-9e55-6b3af38cc596"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:22.005582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-75123bca-fab3-4e2d-a957-fe45235670c9 req-16a3c9ea-fc87-4e7b-8a97-9c18a751b578 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:22.006038 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-75123bca-fab3-4e2d-a957-fe45235670c9 req-16a3c9ea-fc87-4e7b-8a97-9c18a751b578 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:22.018395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-75123bca-fab3-4e2d-a957-fe45235670c9 req-16a3c9ea-fc87-4e7b-8a97-9c18a751b578 service nova] Creating event network-vif-deleted:2efcc93f-177c-4f73-9e55-6b3af38cc596 for instance dc1a3f32-7aab-4b92-81cf-74a18b529bff on hv-cinder-83754 Jun 16 17:48:22.023762 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-75123bca-fab3-4e2d-a957-fe45235670c9 req-16a3c9ea-fc87-4e7b-8a97-9c18a751b578 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032276 Jun 16 17:48:22.024427 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 279/564] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:22.072095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:22.073583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:22.079657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:22.080347 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:22.081146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:22.081588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:22.153565 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:22.161307 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e5acd48a-e17a-4dc5-9304-8e8d06eea0e1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 200 len: 1326 microversion: 2.1 time: 0.093203 Jun 16 17:48:22.161889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 286/565] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:22 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:22.512186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:22.512836 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:22.519861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:22.520609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:22.521391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:22.521831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:22.689576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:22.700472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2a55556a-86f6-4c3d-9cc4-2b920695c55b tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.192562 Jun 16 17:48:22.701274 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 280/566] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:22 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:23.178334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:23.178952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:23.185505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:23.185957 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:23.186724 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:23.187166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:23.200685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff HTTP/1.1 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:48:23.202303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:48:23.203855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'dc1a3f32-7aab-4b92-81cf-74a18b529bff'} Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:48:23.204952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:48:23.206356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:23.207784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:48:23.207784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b8918cb0-03ee-4bcf-a471-748195a91f1a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 404 len: 111 microversion: 2.1 time: 0.030024 Jun 16 17:48:23.207784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 287/567] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:23 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:48:23.212613 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-21354521-25bd-4349-8f6b-a7b5f74bc078 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '.version_select at 0x7f288c2300d0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:23.231378 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-21354521-25bd-4349-8f6b-a7b5f74bc078 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539835213" status: 202 len: 0 microversion: 2.1 time: 0.022604 Jun 16 17:48:23.231931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 281/568] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jun 16 17:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539835213 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:48:23.718911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:23.719529 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:23.726046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:23.726503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:23.727370 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:23.727818 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:23.879969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:23.889341 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b9892b49-0012-4167-b162-e6f4c3f654bc tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.174202 Jun 16 17:48:23.890115 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 288/569] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:23 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:24.081476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7f2e9298-e4a1-408c-a16e-bfeda4c61835 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: .version_select at 0x7f288c1daca0>, body: {"keypair": {"name": "tempest-keypair-676076866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETywhr8/kcUzlOPvwqzh8heaz2fWOtJKahIKfC8FrvOX2fv9bdN0oMf2o54NSR23lmmd2DdnGr8l4B1HUGQTw0WhSQ9l5K8tnegZFbwpgoEbt55OCotuUWdqgKaUF98/g=="}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:24.097104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-7f2e9298-e4a1-408c-a16e-bfeda4c61835 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:48:24.101449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-7f2e9298-e4a1-408c-a16e-bfeda4c61835 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:48:24.125441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7f2e9298-e4a1-408c-a16e-bfeda4c61835 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048117 Jun 16 17:48:24.126040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 282/570] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:48:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:24.452446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:24.453459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:24.461089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:24.461535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:24.462506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:24.462945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:24.486567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lazy-loading 'flavor' on Instance uuid e2b4933f-b046-47e9-a9a4-573fc8b2051d {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:48:24.502300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:24.621834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-903d9422-abcd-406a-815c-f6a8fd0eaf47 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/action" status: 200 len: 32 microversion: 2.1 time: 0.173588 Jun 16 17:48:24.622667 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 289/571] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:48:24 2022] POST /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:48:24.631708 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:24.632571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:24.639217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:24.639961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:24.641109 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:24.641883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:24.646720 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:24.907935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:24.909288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:24.915555 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:24.916012 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:24.916825 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:24.917271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:24.960799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:24.968791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-58bb5e0b-25bb-496c-83ce-263265406481 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.341150 Jun 16 17:48:24.969366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 283/572] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:24 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:25.265676 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:25.274587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cf548d9d-454f-4113-8cb9-e70e174aae56 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.371310 Jun 16 17:48:25.284850 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 290/573] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:24 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:25.986440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:25.987086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:25.993615 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:25.994065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:25.994860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:25.995291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:26.029353 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1772101380", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73e06f90-3f8b-46da-a984-8f18b234443c"}], "security_groups": [{"name": "tempest-securitygroup--769243809"}], "key_name": "tempest-keypair-676076866", "user_data": "}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:26.165160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:26.169434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] validate_networks() for [('73e06f90-3f8b-46da-a984-8f18b234443c', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:48:26.173329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cade8d66-f526-4bf4-ab8e-e7c70df926b3 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.191083 Jun 16 17:48:26.173910 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 284/574] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:25 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:26.292830 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:26.293404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:26.299594 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:26.300047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:26.300857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:26.301296 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:26.521029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:26.529699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-eb096d56-3db5-4f41-bfcf-4aeb5dd54a46 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.241037 Jun 16 17:48:26.530269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 285/575] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:26 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:26.617249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:48:26.617671 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:48:26.618145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:48:26.618552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:48:26.619013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:48:26.627843 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:26.628290 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:26.629109 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:26.629568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:26.646492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:48:26.650323 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:48:26.661476 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:48:26.663696 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:48:26.710061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-76b2a994-370b-425a-a71e-bde2e4f1da26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684897 Jun 16 17:48:26.711017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 291/576] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:48:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:48:26.721559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-972f4a5e-83f7-4d49-a708-680179309aee tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:26.722178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-972f4a5e-83f7-4d49-a708-680179309aee tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:26.776568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-972f4a5e-83f7-4d49-a708-680179309aee tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:26.783805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-972f4a5e-83f7-4d49-a708-680179309aee tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1241 microversion: 2.1 time: 0.066770 Jun 16 17:48:26.784398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 286/577] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:26 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:27.190338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:27.191080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:27.197725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.198179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.198948 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.199393 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.338415 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:27.347019 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3b905f5d-86c2-4e88-bdfe-fdf6b39aebbc tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.161088 Jun 16 17:48:27.347587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 292/578] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:27 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:27.547604 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:27.548164 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:27.554802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.555248 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.556006 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.556465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.571474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:27.572024 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:27.579112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.580164 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.580996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.581439 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.611955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-121b8fc0-92aa-417f-96d1-f08b7aa34459 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments/80b1d185-a78b-49a8-8968-7f24234a45bc" status: 200 len: 194 microversion: 2.20 time: 0.048881 Jun 16 17:48:27.612579 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 293/579] 10.222.0.42 () {60 vars in 1453 bytes} [Thu Jun 16 17:48:27 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments/80b1d185-a78b-49a8-8968-7f24234a45bc => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:48:27.679742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:27.680325 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:27.687543 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.688108 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.689520 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.690034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.707792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:27.719181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d261d8ce-95dc-4c22-8c2c-5f0bbe57468a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.175078 Jun 16 17:48:27.723369 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 287/580] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:27 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:27.777022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lazy-loading 'services' on Instance uuid dd9a2013-38fe-499c-a84e-97e2ca6e48ea {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:48:27.800684 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:27.801228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:27.807684 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.808134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.808980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.809415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.867764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e0f91ba4-9c24-49a3-9ad3-aebf2b1c9deb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments/80b1d185-a78b-49a8-8968-7f24234a45bc" status: 202 len: 0 microversion: 2.20 time: 0.192035 Jun 16 17:48:27.868354 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 294/581] 10.222.0.42 () {60 vars in 1456 bytes} [Thu Jun 16 17:48:27 2022] DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments/80b1d185-a78b-49a8-8968-7f24234a45bc => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:48:27.877657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:27.878751 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:27.886149 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.886596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.887420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:27.888183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:27.910918 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:27.927375 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-409af731-7e18-4303-84c0-d6daac464b26 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1301 microversion: 2.1 time: 0.129766 Jun 16 17:48:27.929263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9b7d7c5c-dc55-4491-ad9b-93e5c03939fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056279 Jun 16 17:48:27.929670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 288/582] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:27 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:27.933120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 295/583] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jun 16 17:48:27 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:48:28.364515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:28.365033 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:28.371080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.371525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.372285 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.372742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.502765 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:28.511097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-79ff50e0-8c24-4c43-bf45-73689b5cd529 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.151130 Jun 16 17:48:28.511650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 289/584] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:28 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:28.740027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:28.740717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:28.747436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.748157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.749049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.749568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.941164 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:28.942125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:28.948670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.949125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.949924 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.950370 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.964207 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:28.976150 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f4c0fe6c-2118-4b44-ba5e-4078852ee698 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.240005 Jun 16 17:48:28.977291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 296/585] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:28 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:28.982273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:28.982975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:28.989915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.990107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:28.990909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:28.991151 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-93f64146-4ebc-4494-a00a-ca8e926d99a0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054441 Jun 16 17:48:28.991731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 290/586] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jun 16 17:48:28 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:48:28.992003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:29.071419 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:29.079105 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-df498e81-3b4c-49d7-9cc8-ffe0eb7e6bdf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1299 microversion: 2.1 time: 0.100585 Jun 16 17:48:29.080266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 297/587] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:28 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:29.528761 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:29.529272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:29.536116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:29.536599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:29.537364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:29.537798 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:29.738641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:29.748270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3eff30b9-6633-4922-9ef4-d439e47ec84c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.223809 Jun 16 17:48:29.748807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 291/588] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:29 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:29.962188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-5736d4f5-2bff-46ec-8d49-d4ebcfddb218 req-d0fbc4a7-b79b-4445-ba4e-b0ad25cfa793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab2d5df-1539-4e63-a3ee-269f6116bbb8", "tag": "58b55dc3-484d-43c6-a29e-6468b7b97a54"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:29.976563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5736d4f5-2bff-46ec-8d49-d4ebcfddb218 req-d0fbc4a7-b79b-4445-ba4e-b0ad25cfa793 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:29.977008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5736d4f5-2bff-46ec-8d49-d4ebcfddb218 req-d0fbc4a7-b79b-4445-ba4e-b0ad25cfa793 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:29.991611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-5736d4f5-2bff-46ec-8d49-d4ebcfddb218 req-d0fbc4a7-b79b-4445-ba4e-b0ad25cfa793 service nova] Creating event network-changed:58b55dc3-484d-43c6-a29e-6468b7b97a54 for instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 on hv-cinder-83754 Jun 16 17:48:29.997359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-5736d4f5-2bff-46ec-8d49-d4ebcfddb218 req-d0fbc4a7-b79b-4445-ba4e-b0ad25cfa793 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039332 Jun 16 17:48:29.998717 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:29.999302 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 298/589] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:29.999408 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:30.007200 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:30.007379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.007820 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.008650 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:30.008786 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.009092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.017891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.018567 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.019507 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.019947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.053429 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-09a49d8a-99eb-4f03-a320-6d5e3804ad68 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052585 Jun 16 17:48:30.054122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 299/590] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jun 16 17:48:29 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:30.101512 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:30.102134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:30.117368 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.117954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.119204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.119750 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.315922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:30.324342 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cb3e48a6-16a7-4e76-b474-72f5550ab3f9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.334219 Jun 16 17:48:30.324955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 292/591] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:29 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:30.332002 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:30.332678 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:30.339288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.339663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.340486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.340922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.367265 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:48:30.404526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:30.413999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ddd5f533-561a-4105-aef7-ddd7d3ae4760 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.320826 Jun 16 17:48:30.414708 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 300/592] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:30 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:30.446012 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7022010e-be9b-41b1-9a08-baae43fa99f9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 204 len: 0 microversion: 2.20 time: 0.119781 Jun 16 17:48:30.446776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 293/593] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jun 16 17:48:30 2022] DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:48:30.455449 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:30.456120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:30.462186 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.462629 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.463410 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.463862 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.591206 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:30.599575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:30.601392 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:30.602836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-efa78567-bc1f-4951-aea1-0103e8188345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.151846 Jun 16 17:48:30.603395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 301/594] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:30 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:30.767792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:30.768530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:30.774537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.774996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.775768 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:30.776208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:30.909549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:30.917586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a374769b-d2f8-49d0-ac08-2951f7f6598a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.154847 Jun 16 17:48:30.918139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 294/595] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:30 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:31.341984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:31.342602 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:31.351318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.351810 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.352623 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.353061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.431130 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:31.431850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:31.439761 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.440391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.441211 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.441647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.812121 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:31.816969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:31.820146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-75202d96-af95-4dfe-ab1f-739a8152dabc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.392879 Jun 16 17:48:31.820829 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 295/596] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:31 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:31.825240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:31.825615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-910e2eca-e773-4ab6-9706-07313ba4fd02 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.487334 Jun 16 17:48:31.825832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:31.826399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 302/597] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:31 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:31.833899 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.834349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.835118 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.835554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.934815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:31.935425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:31.942008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.942456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.943313 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:31.943754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:31.964150 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:31.972918 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:31.974566 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:31.975813 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2cef6d03-69d9-4156-b92f-44fb15607043 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.154065 Jun 16 17:48:31.976480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 296/598] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:31 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:32.072938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:32.080898 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0020872a-1589-4741-bf7f-8db767c5ec13 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.149875 Jun 16 17:48:32.081469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 303/599] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:31 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:32.837585 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:32.838117 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:32.842945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:32.843566 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:32.844815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:32.845327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:32.846098 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:32.846533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:32.850184 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:32.850643 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:32.851415 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:32.851861 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:33.041374 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:33.049330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c8773be1-cb7c-4f6f-98d4-67e48ca9dcea tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.215363 Jun 16 17:48:33.049911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 297/600] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:32 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:33.054402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:33.055005 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:33.062430 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:33.062956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:33.064395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:33.064846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:33.065009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:33.075383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a0b64e0b-d245-4425-b715-33cb4f4e2842 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.236227 Jun 16 17:48:33.075960 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 304/601] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:32 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:33.098206 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:33.098646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:33.105580 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:33.106071 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:33.106853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:33.107293 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:33.125511 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:33.245860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:33.254797 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:33.256323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:33.257511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ddf8dd3d-ebf3-46c7-87dd-e925fbde8332 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.206677 Jun 16 17:48:33.258080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 298/602] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:33 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:33.275890 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:33.283828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7ef5ab4e-9be7-47d6-8522-360e82cb4c6b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.189983 Jun 16 17:48:33.284420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 305/603] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:33 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:34.066359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:34.067055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:34.073659 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.074101 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.074865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.075304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.081057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:34.093336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:34.093980 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:34.101203 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.102527 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.103343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.104069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.494834 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:34.503172 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bde5adfb-d7f0-4ac1-8b81-65c41952b9ce tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.440972 Jun 16 17:48:34.503749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 299/604] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:34 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:34.508267 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:34.508905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:34.515254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.515653 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.516462 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.517503 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.560122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:34.569107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e468d53e-2607-4aa9-ac5c-2f984ee3ff5f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.479849 Jun 16 17:48:34.569674 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 306/605] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:34 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:34.574089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:34.574711 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:34.581466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.582197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.582971 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:34.583405 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:34.862252 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:34.874088 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:34.874670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:34.875605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:34.877291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8a742b86-0d3f-49bb-b170-e62b65a456cf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 200 len: 1725 microversion: 2.20 time: 0.372552 Jun 16 17:48:34.888813 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 300/606] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:34 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:34.889557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a5be4f49-720e-4abe-94ca-835e7269f25a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.318851 Jun 16 17:48:34.890291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 307/607] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:34 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:35.140741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-eddc9690-b541-4285-8d5b-55611c3532a5 req-25ed3f66-e34f-4082-98ca-b63db67474f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a2013-38fe-499c-a84e-97e2ca6e48ea", "name": "network-vif-deleted", "tag": "654117c0-3630-4d2f-815c-dcfac6206d1f"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:35.152982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-eddc9690-b541-4285-8d5b-55611c3532a5 req-25ed3f66-e34f-4082-98ca-b63db67474f4 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.153676 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-eddc9690-b541-4285-8d5b-55611c3532a5 req-25ed3f66-e34f-4082-98ca-b63db67474f4 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.165193 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-eddc9690-b541-4285-8d5b-55611c3532a5 req-25ed3f66-e34f-4082-98ca-b63db67474f4 service nova] Creating event network-vif-deleted:654117c0-3630-4d2f-815c-dcfac6206d1f for instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea on hv-cinder-83754 Jun 16 17:48:35.170596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-eddc9690-b541-4285-8d5b-55611c3532a5 req-25ed3f66-e34f-4082-98ca-b63db67474f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033446 Jun 16 17:48:35.176095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 301/608] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:35.520932 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:35.521533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:35.528337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.528831 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.529624 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.530068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.587049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:35.587666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:35.594379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.594882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.596433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.596928 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.703148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:35.712186 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a5dbcbfb-2c0b-4feb-8b46-4d663429a52c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.195792 Jun 16 17:48:35.717939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:35 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:35.799279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:35.807807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4f7fb92f-7d5e-44c9-bb8e-91c05ffa4634 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1755 microversion: 2.1 time: 0.225015 Jun 16 17:48:35.808621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 302/610] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:35 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:35.897433 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:35.898372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:35.906183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.906785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.907991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.908956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.909357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:35.910231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:35.915841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:35.920953 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.921504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.922406 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:35.922982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:35.925217 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] HTTP exception thrown: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Request method failure captured: Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea HTTP/1.1 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpdg63gqjmAZ4jJTBFAE_nUMU6MT0Bzb1jL1tgVxu4cvNQ4DwY7VFNT8wte3-3pm2RgfRM64ZMj1QFSbo65nZ8_V3xFfU5SndCCD9tXe9R4sxqdA9sKvHn5wwhwANT4dgsQ5iuCz0h5SIml0LGVyj5VPr7LS_gKtyYfkd7AO2Z83s Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:48:35.927259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc6671e3a8bd4821b17ef2d2a426ee58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 7b078c6bfca04de790e7b2e45739033e Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:48:35.928947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'dd9a2013-38fe-499c-a84e-97e2ca6e48ea'} Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:48:35.929915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:48:35.931282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:35.932573 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Returning 404 to user: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:48:35.932573 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4cab8d12-fac3-41c8-9b5f-7555dd3c59b5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 404 len: 111 microversion: 2.20 time: 0.035861 Jun 16 17:48:35.933405 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 309/611] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:35 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:48:35.938259 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1d468e26-581e-4f0f-bfec-868b7a0e9704 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '.version_select at 0x7f288c0b44c0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:35.945746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:35.961780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1d468e26-581e-4f0f-bfec-868b7a0e9704 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-978873875" status: 204 len: 0 microversion: 2.20 time: 0.027261 Jun 16 17:48:35.962783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 310/612] 10.222.0.42 () {60 vars in 1258 bytes} [Thu Jun 16 17:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-978873875 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:48:36.158866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:36.167860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c9bd7fc9-7497-4287-828e-fba236000c5e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.264736 Jun 16 17:48:36.171296 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 303/613] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:35 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:36.716251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:36.717017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=6 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:36.722743 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-31c4d720-b723-4ce0-aa0f-7bb70849e328 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'create', calling method: .version_select at 0x7f287ff9c0d0>, body: {"keypair": {"name": "tempest-keypair-479319083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGx/FgPTTfKZOT9Ope0qkX7x1KaVRSD1DWpOtxF5M+f9Z6xKOE+svja1paOWLXLW6k2DvvSL8GK6dM0pRz2oRJdvVgXyEJD7ZXduMt62oJG3SHCTuEWuI/hsbDWOjo6nSw=="}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:36.731015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:36.731772 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:36.738539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:36.739002 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:36.739814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:36.740257 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:36.741588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-31c4d720-b723-4ce0-aa0f-7bb70849e328 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:48:36.746521 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-31c4d720-b723-4ce0-aa0f-7bb70849e328 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for user 7b078c6bfca04de790e7b2e45739033e and project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:48:36.771657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-31c4d720-b723-4ce0-aa0f-7bb70849e328 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056758 Jun 16 17:48:36.772257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 311/614] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Jun 16 17:48:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 17:48:36.781131 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:36.827536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:36.828158 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:36.836087 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:36.836655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:36.837629 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:36.838209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:36.927525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:36.936085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a549e7cb-fbbd-44bf-be2d-16fc52750e04 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.210025 Jun 16 17:48:36.936819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 304/615] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:36 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:37.016008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:37.024968 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c54a47d4-bdf0-4c61-a2dc-af89cc6fcb6d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1758 microversion: 2.1 time: 0.202758 Jun 16 17:48:37.025572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 312/616] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:36 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:37.185422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:37.186724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:37.196484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:37.197025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:37.197854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:37.198434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:37.331989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:37.340039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7ca7dcab-fecb-4b45-b6ce-965605e7e758 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.158452 Jun 16 17:48:37.340644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 305/617] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:37 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:37.529607 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-5dc03725-e01b-46c9-bfdb-166890ebdcff req-230378d1-0f83-4dde-88db-740f5cf60882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab2d5df-1539-4e63-a3ee-269f6116bbb8", "name": "network-vif-plugged", "status": "completed", "tag": "58b55dc3-484d-43c6-a29e-6468b7b97a54"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:37.539598 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5dc03725-e01b-46c9-bfdb-166890ebdcff req-230378d1-0f83-4dde-88db-740f5cf60882 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:37.540649 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5dc03725-e01b-46c9-bfdb-166890ebdcff req-230378d1-0f83-4dde-88db-740f5cf60882 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:37.553138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-5dc03725-e01b-46c9-bfdb-166890ebdcff req-230378d1-0f83-4dde-88db-740f5cf60882 service nova] Creating event network-vif-plugged:58b55dc3-484d-43c6-a29e-6468b7b97a54 for instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 on hv-cinder-83754 Jun 16 17:48:37.558272 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-5dc03725-e01b-46c9-bfdb-166890ebdcff req-230378d1-0f83-4dde-88db-740f5cf60882 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033193 Jun 16 17:48:37.558878 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 313/618] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:48:37.952858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:37.953359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:37.959992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:37.960464 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:37.961228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:37.961665 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:38.098068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:38.108065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8bc97ec4-a56c-402e-bff7-e57e59c8ec48 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.159186 Jun 16 17:48:38.108792 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 306/619] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:37 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:38.111497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1299098582", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "639fb565-e4f0-4aac-b614-b6cb5489e420"}], "security_groups": [{"name": "tempest-securitygroup--627789792"}], "key_name": "tempest-keypair-479319083", "user_data": "}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:38.213940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] validate_networks() for [('639fb565-e4f0-4aac-b614-b6cb5489e420', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:48:38.356917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:38.357527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:38.364877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:38.365331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:38.366097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:38.366526 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:38.819847 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:38.827677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8c265824-ed0a-49d7-b5f7-126a4fed2385 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.474516 Jun 16 17:48:38.828250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 307/620] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:38 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:38.888397 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:48:38.888837 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:48:38.889315 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:48:38.889808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:48:38.890236 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:48:38.899686 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:38.900135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:38.900961 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:38.901400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:38.918671 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:48:38.923581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Getting quotas for user 7b078c6bfca04de790e7b2e45739033e and project bc6671e3a8bd4821b17ef2d2a426ee58. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:48:38.936312 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:48:38.939687 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:48:38.987984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-658d5e08-821a-434b-9c66-aa5cf7ae81d8 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.882103 Jun 16 17:48:38.988575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 314/621] 10.222.0.42 () {62 vars in 1187 bytes} [Thu Jun 16 17:48:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 17:48:38.998369 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-00a0b0d7-30cc-4144-9cd6-64bdc70adee2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:38.998994 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-00a0b0d7-30cc-4144-9cd6-64bdc70adee2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:39.053529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-00a0b0d7-30cc-4144-9cd6-64bdc70adee2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:39.060630 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-00a0b0d7-30cc-4144-9cd6-64bdc70adee2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:39.062520 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-00a0b0d7-30cc-4144-9cd6-64bdc70adee2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:39.063228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-00a0b0d7-30cc-4144-9cd6-64bdc70adee2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1281 microversion: 2.20 time: 0.068647 Jun 16 17:48:39.065571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 308/622] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:38 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:39.126983 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:39.127599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:39.134219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:39.134918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:39.135697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:39.136169 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:39.274277 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:39.281833 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4d18b7ad-5c87-4e2f-829c-bb40eefbfb47 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1366 microversion: 2.1 time: 0.159719 Jun 16 17:48:39.282881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 315/623] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:39 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:39.843945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:39.844603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:39.856556 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:39.857024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:39.857802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:39.858245 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:39.995297 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:40.003524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-dbd5ab75-0b98-46b7-a6cb-ad054422595f tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.163424 Jun 16 17:48:40.004086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 309/624] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:39 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:40.082387 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:40.083031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:40.090011 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:40.090465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:40.091222 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:40.091657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:40.152577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:40.161389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:40.162884 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:40.163974 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9b8f3463-3871-4231-a8e1-cd27c8871515 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1333 microversion: 2.20 time: 0.085504 Jun 16 17:48:40.164547 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 316/625] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:40 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:40.299665 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:40.300194 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:40.307496 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:40.308191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:40.309363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:40.309807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:40.495015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:40.503124 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ea9200d4-7402-488d-8850-7a384c304c25 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1556 microversion: 2.1 time: 0.207956 Jun 16 17:48:40.503682 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 310/626] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:40 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1556 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:40.520865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:40.521359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:40.528689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:40.529140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:40.529911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:40.530339 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:40.614420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-016181b5-25ba-46f5-b4a0-99edf989b4fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098932 Jun 16 17:48:40.615007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 317/627] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:48:40 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:41.022557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:41.024115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:41.031318 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:41.032019 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:41.034295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:41.034746 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:41.182719 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:41.183857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:41.191056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:41.191513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:41.193034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:41.193487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:41.226883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:41.246581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ac962fb2-fa25-41a1-a80d-074b73b368b7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.228671 Jun 16 17:48:41.247508 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 311/628] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:41 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:41.487659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:41.495945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:41.497476 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:41.498806 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5e40c1a2-6f86-446d-81fb-3c919813b9e0 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.320551 Jun 16 17:48:41.510896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 318/629] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:41 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:41.630329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-1cf8002d-a4dd-458d-b541-94dd59612841 req-ad081f1c-48f3-491e-82cd-b9ab03ec9ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab2d5df-1539-4e63-a3ee-269f6116bbb8", "tag": "58b55dc3-484d-43c6-a29e-6468b7b97a54"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:41.639042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1cf8002d-a4dd-458d-b541-94dd59612841 req-ad081f1c-48f3-491e-82cd-b9ab03ec9ede service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:41.639215 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1cf8002d-a4dd-458d-b541-94dd59612841 req-ad081f1c-48f3-491e-82cd-b9ab03ec9ede service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:41.650758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-1cf8002d-a4dd-458d-b541-94dd59612841 req-ad081f1c-48f3-491e-82cd-b9ab03ec9ede service nova] Creating event network-changed:58b55dc3-484d-43c6-a29e-6468b7b97a54 for instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 on hv-cinder-83754 Jun 16 17:48:41.655754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-1cf8002d-a4dd-458d-b541-94dd59612841 req-ad081f1c-48f3-491e-82cd-b9ab03ec9ede service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029950 Jun 16 17:48:41.656353 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 312/630] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:42.265187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:42.265805 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:42.286063 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:42.287223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:42.288046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:42.288524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:42.520385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:42.530479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:42.537507 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:42.537965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:42.538833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:42.539411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:42.695991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:42.705815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ef88dbc1-c226-4d40-ab8a-295e6da7b4dd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.444405 Jun 16 17:48:42.706411 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 319/631] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:42 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:42.911939 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:42.919970 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:42.921584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:42.922685 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-35ac568e-7f9c-4ea9-9130-ac26dc5aee37 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.407612 Jun 16 17:48:42.924525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 313/632] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:42 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:48:43.398162 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-0165e093-df32-4e9f-85e4-9e6420642250 req-bc31467b-1881-4009-bb30-0eaa906b487e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:43.407531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-0165e093-df32-4e9f-85e4-9e6420642250 req-bc31467b-1881-4009-bb30-0eaa906b487e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:43.408356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-0165e093-df32-4e9f-85e4-9e6420642250 req-bc31467b-1881-4009-bb30-0eaa906b487e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:43.420343 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-0165e093-df32-4e9f-85e4-9e6420642250 req-bc31467b-1881-4009-bb30-0eaa906b487e service nova] Creating event network-changed:90e9b67c-83ca-4a1b-b4d9-2731c84f1413 for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 on hv-cinder-83754 Jun 16 17:48:43.433616 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-0165e093-df32-4e9f-85e4-9e6420642250 req-bc31467b-1881-4009-bb30-0eaa906b487e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038831 Jun 16 17:48:43.434397 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 320/633] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:43.723219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:43.723959 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:43.730899 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:43.731359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:43.732150 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:43.732618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:43.908823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:43.918259 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1b076df7-3c80-4a7e-90a8-a991cb2474d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1736 microversion: 2.1 time: 0.199659 Jun 16 17:48:43.918835 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 314/634] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:43 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:43.943001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:43.943702 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:43.950033 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:43.950484 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:43.951306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:43.951754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.083484 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:44.091399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:44.092927 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:44.094034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3258e6ab-0fdc-49e3-9cce-2c43cdb189e7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.155999 Jun 16 17:48:44.095112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 321/635] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:43 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:44.195669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:44.196706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:44.202903 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.203361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.204190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.204664 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.233532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-71fe5fb4-222a-4c20-865c-4147534cc9b3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043101 Jun 16 17:48:44.234163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 315/636] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:48:44 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:48:44.292475 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:44.292909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:44.300749 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.301217 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.301997 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.302442 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.329218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:48:44.405663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7dfda528-a62f-4a7f-80fa-233a5cda34b6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 204 len: 0 microversion: 2.1 time: 0.116767 Jun 16 17:48:44.406376 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 322/637] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:48:44 2022] DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:48:44.415879 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:44.416530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:44.422577 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.424744 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.425579 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.426029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.696963 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:44.705232 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e81fe0cb-903c-4173-8037-3fecb0be2dc5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1673 microversion: 2.1 time: 0.293114 Jun 16 17:48:44.705738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 316/638] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:44 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1673 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:44.940789 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:44.941551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:44.947553 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.948010 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:44.948823 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:44.949265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.083463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:45.091457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-63c50fe2-a911-4531-8faa-3bfd1a2de3f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1716 microversion: 2.1 time: 0.155312 Jun 16 17:48:45.092021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 323/639] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:44 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:45.112340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:45.112982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:45.119778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.120227 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.121030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.121589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.197049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:45.197635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:45.203719 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.204844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.206191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.207003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.257850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:45.267280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:45.268864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:45.270029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e07a4720-cfdd-409d-b658-0caf85b0064c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.162192 Jun 16 17:48:45.270609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 317/640] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:45 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:45.455557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] HTTP exception thrown: Cannot 'detach_volume' instance e2b4933f-b046-47e9-a9a4-573fc8b2051d while it is in vm_state rescued Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Request method failure captured: Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments/7492fc79-0643-4ebf-8546-35012e5b43d4 HTTP/1.1 Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpZMBWfbYYv8MskhFdjKunGOLOW3u46steyppa9ycLucosvadyy1Z0Cv9eZXLnn_X3B2oENgqUbBw9XTYlK3LNrIJYCU0DEweCvNQ371qBo0NWO_5UsoOBIgnqL8VFksWOCaQC_FuMMCVDggwNXjJTZxjC8vzksPKbFTPoqIRSPFc Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:48:45.457179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feb571d68c6c4a1ab9e7b175f5a6e0b3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 268c5947a265492bb7a8f181f9f5c504 Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:48:45.458683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Cannot 'detach_volume' instance e2b4933f-b046-47e9-a9a4-573fc8b2051d while it is in vm_state rescued Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'server_id': 'e2b4933f-b046-47e9-a9a4-573fc8b2051d', 'id': '7492fc79-0643-4ebf-8546-35012e5b43d4'} Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:48:45.459450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e2b4933f-b046-47e9-a9a4-573fc8b2051d while it is in vm_state rescued Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e2b4933f-b046-47e9-a9a4-573fc8b2051d while it is in vm_state rescued Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:48:45.460907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Returning 409 to user: Cannot 'detach_volume' instance e2b4933f-b046-47e9-a9a4-573fc8b2051d while it is in vm_state rescued {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:48:45.461977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8c7c1ab0-144f-4b9a-bf26-3f76cd571c4c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments/7492fc79-0643-4ebf-8546-35012e5b43d4" status: 409 len: 152 microversion: 2.1 time: 0.266078 Jun 16 17:48:45.461977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 324/641] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:48:45 2022] DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments/7492fc79-0643-4ebf-8546-35012e5b43d4 => generated 152 bytes in 267 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 17:48:45.468509 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:45.469053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:45.475350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.475801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.476604 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.477068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.480933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=100 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:45.542349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3c2bff36-8588-4fce-a020-063ffac71e86 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "POST /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/action" status: 202 len: 0 microversion: 2.1 time: 0.077589 Jun 16 17:48:45.542977 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 318/642] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:48:45 2022] POST /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:48:45.551648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:45.552263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:45.559107 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.559559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.560324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.560793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.578692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:45.689218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:45.697575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8f0200da-8230-47b9-bbde-622261cf3c12 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1724 microversion: 2.1 time: 0.150332 Jun 16 17:48:45.698069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 325/643] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:45 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:45.723171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:45.723869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:45.730078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.730529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.731294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:45.731732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:45.864672 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:45.872226 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fb909dbd-b2f7-49d6-b83d-85ab2f7e5a1f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1673 microversion: 2.1 time: 0.153751 Jun 16 17:48:45.872810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 319/644] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:45 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:46.289872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:46.290396 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:46.296581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:46.297036 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:46.297851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:46.298300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:46.511913 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:46.521075 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:46.522582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:46.523715 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c9ef983d-f8a3-4469-b861-e08579f5badd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.238981 Jun 16 17:48:46.524268 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 326/645] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:46 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:46.714910 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:46.715531 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:46.723445 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:46.723907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:46.724998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:46.725190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:46.889786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:46.890635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:46.897088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:46.897638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:46.898480 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:46.898986 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:47.446922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:47.455300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-143440e5-94a5-454a-bda6-e5ed02967972 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1724 microversion: 2.1 time: 0.744151 Jun 16 17:48:47.456191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 320/646] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:46 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1724 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:47.542201 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:47.543142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:47.549904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:47.550356 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:47.551135 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:47.551580 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:47.652677 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:47.660748 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1f59d39e-3839-4596-9e57-40260ed9e818 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1673 microversion: 2.1 time: 0.774904 Jun 16 17:48:47.661317 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 327/647] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:46 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1673 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:47.987167 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:47.995704 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:47.997254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:47.998372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-805502ac-50aa-4892-aa9a-fa7a1dd91d67 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.460186 Jun 16 17:48:47.998923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 321/648] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:47 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:48:48.472310 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:48.472892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:48.480620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:48.481081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:48.481952 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:48.482446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:48.677821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:48.678367 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:48.684455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:48.684917 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:48.685697 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:48.686140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:48.707835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:48.718065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-68bdc2a4-d41a-4e0f-8c33-2bd9865ab559 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1724 microversion: 2.1 time: 0.249278 Jun 16 17:48:48.719064 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 328/649] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:48 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:48.776149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:48.787663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-3ad45990-4911-443d-98df-55be3c2403ec req-c11d59eb-4334-4931-b7ff-599b619ff40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6228596e-39a4-457c-bdad-6fb60dc046f6", "name": "network-vif-deleted", "tag": "4b250132-04cb-44f4-9f14-4f5e43091658"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:48.791158 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5d0e543a-35b7-4f9c-be3a-95b2e14c7406 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1606 microversion: 2.1 time: 0.117138 Jun 16 17:48:48.795887 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3ad45990-4911-443d-98df-55be3c2403ec req-c11d59eb-4334-4931-b7ff-599b619ff40d service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:48.796333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3ad45990-4911-443d-98df-55be3c2403ec req-c11d59eb-4334-4931-b7ff-599b619ff40d service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:48.800192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 322/650] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:48 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1606 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:48.810756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-3ad45990-4911-443d-98df-55be3c2403ec req-c11d59eb-4334-4931-b7ff-599b619ff40d service nova] Creating event network-vif-deleted:4b250132-04cb-44f4-9f14-4f5e43091658 for instance 6228596e-39a4-457c-bdad-6fb60dc046f6 on hv-cinder-83754 Jun 16 17:48:48.816835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-3ad45990-4911-443d-98df-55be3c2403ec req-c11d59eb-4334-4931-b7ff-599b619ff40d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Jun 16 17:48:48.817459 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 329/651] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:48:49.017108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:49.017643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:49.023575 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.024022 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.024822 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.025257 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.057359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:49.158030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:49.166072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:49.167589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:49.168733 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9209081a-52a3-4abd-bbef-1d181b0157db tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.155810 Jun 16 17:48:49.169304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 323/652] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:49 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:49.732290 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:49.733142 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=10 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:49.739716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:49.740674 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:49.748786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.749245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.750032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.750484 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.808173 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:49.808745 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:49.816114 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.816541 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.817317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.817765 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.851062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:49.851954 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:49.852154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lazy-loading 'fault' on Instance uuid 6228596e-39a4-457c-bdad-6fb60dc046f6 {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:48:49.904568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:49.913443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-417d752b-d552-4761-8f12-6c531899fafe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1724 microversion: 2.1 time: 0.182068 Jun 16 17:48:49.914431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 330/653] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:49 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:49.932208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:49.941577 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-616380fe-11b0-4afc-97ff-f15f6c1db0f3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1327 microversion: 2.1 time: 0.137331 Jun 16 17:48:49.942499 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 324/654] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:49 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:50.187181 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:50.187796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:50.194239 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:50.194696 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:50.195460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:50.195907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:50.328803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:50.336957 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:50.338450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:50.339548 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9c900c2d-789f-4081-a6a2-df7594b6ca39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.156274 Jun 16 17:48:50.340423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 331/655] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:50 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:48:50.931009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:50.931645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:50.938130 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:50.939990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:50.939990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:50.940449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:50.961637 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:50.962379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:50.968987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:50.969541 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:50.970912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:50.971357 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:51.004932 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:51.005385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:51.005834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lazy-loading 'fault' on Instance uuid 6228596e-39a4-457c-bdad-6fb60dc046f6 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:48:51.069955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:51.077513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f22f8c74-0446-49ef-9ce7-db41356a1cb2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 200 len: 1327 microversion: 2.1 time: 0.119743 Jun 16 17:48:51.078082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 332/656] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:50 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:48:51.136851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:51.145479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f143e896-3a59-45c3-b043-1c7bc7d89cfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1724 microversion: 2.1 time: 0.218297 Jun 16 17:48:51.146041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 325/657] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:50 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:51.357869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:51.358448 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:51.365927 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:51.366398 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:51.367196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:51.367635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:51.515604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:51.524668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:51.526165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:51.527276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bf2ab8b3-a8ec-404c-8b01-12e03fd49c96 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.173344 Jun 16 17:48:51.527839 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 333/658] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:51 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:52.096128 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:52.096925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:52.103887 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.104705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.105732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.106393 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.123543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] HTTP exception thrown: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Request method failure captured: Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 HTTP/1.1 Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vgR8n1COjIKtBoDmaAKwtDUbsGHd2ekfio9Gck7tClkdpH7TQzLKJJYefcWxDdy-N7KCnTXNuAUp631tr55OYrYK89HYWxgv-7q_HqIl67U6bwIbTmDNpDuktlD2xPkyJZw3ZfeEJqU9qmyZ5w4MiICbjoDtV5-TvIC0XvjGyo6XI Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:48:52.125321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd279f49cbd84e9f926aa6372a4728d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 813dd0cf7e1d4724b903b358aaac1ea7 Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:48:52.127450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '6228596e-39a4-457c-bdad-6fb60dc046f6'} Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:48:52.128247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:48:52.129447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:48:52.133176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Returning 404 to user: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:48:52.133176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-75360f76-85f4-45c5-a34e-af9149660dc0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 404 len: 111 microversion: 2.1 time: 0.036873 Jun 16 17:48:52.133176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 326/659] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:52 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:48:52.138450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c0f32145-1308-411f-b9df-8463a1da50b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '.version_select at 0x7f288c0c3d30>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:52.156247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c0f32145-1308-411f-b9df-8463a1da50b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730218439" status: 202 len: 0 microversion: 2.1 time: 0.022309 Jun 16 17:48:52.160089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 334/660] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jun 16 17:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730218439 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:48:52.162673 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:52.163312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:52.169463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.169920 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.170687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.171125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.319530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:52.347391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d9616ad7-a270-4861-89e1-05e207c93f64 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1730 microversion: 2.1 time: 0.186754 Jun 16 17:48:52.348365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 327/661] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:52 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:52.363570 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:52.364068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:52.371126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.371586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.372389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.372834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.477749 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-719cf18b-1f7a-4932-bafb-67ad1112f1f9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118073 Jun 16 17:48:52.478524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 335/662] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:48:52 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:52.545246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:52.546170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:52.554421 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.554867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.555656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:52.556476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:52.786053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:52.795708 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:52.797277 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:52.798650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5ad7fda1-d14d-4da1-a832-8f17f0b6ac92 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.257126 Jun 16 17:48:52.799210 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 328/663] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:52 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:53.409470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-fc817cfa-9f9d-4a0b-8cac-c82e2a86cda6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: .version_select at 0x7f288c0640d0>, body: {"keypair": {"name": "tempest-keypair-1958829179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE+xGPxBaf0NdIw2kkSLIz09GCT+s3LJf7aTT14UlhxMjak5yl5p3DtOtzPReW31w3zOT3TrhWghBGz7QRgGqN+9rL/HZ2NWqXwhAtMr/O5u7CxtdEsqTSamQgqheEueA=="}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:53.424870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-fc817cfa-9f9d-4a0b-8cac-c82e2a86cda6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:48:53.430258 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-fc817cfa-9f9d-4a0b-8cac-c82e2a86cda6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for user 813dd0cf7e1d4724b903b358aaac1ea7 and project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'key_pairs'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:48:53.448883 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:53.458824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-fc817cfa-9f9d-4a0b-8cac-c82e2a86cda6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053727 Jun 16 17:48:53.460134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 336/664] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:48:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:53.536626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-924a8e34-ec5f-48ce-888c-648dbbffe975 req-c6a5f0d8-67ad-4bdc-84c2-a09b4c8e808e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "name": "network-vif-plugged", "status": "completed", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:53.547325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-924a8e34-ec5f-48ce-888c-648dbbffe975 req-c6a5f0d8-67ad-4bdc-84c2-a09b4c8e808e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:53.548584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-924a8e34-ec5f-48ce-888c-648dbbffe975 req-c6a5f0d8-67ad-4bdc-84c2-a09b4c8e808e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:53.561062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-924a8e34-ec5f-48ce-888c-648dbbffe975 req-c6a5f0d8-67ad-4bdc-84c2-a09b4c8e808e service nova] Creating event network-vif-plugged:90e9b67c-83ca-4a1b-b4d9-2731c84f1413 for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 on hv-cinder-83754 Jun 16 17:48:53.567018 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-924a8e34-ec5f-48ce-888c-648dbbffe975 req-c6a5f0d8-67ad-4bdc-84c2-a09b4c8e808e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033880 Jun 16 17:48:53.568141 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 329/665] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:53.822696 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:53.823555 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:53.832462 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:53.833186 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:53.834253 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:53.835084 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:53.917602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-11b9a69a-aaaf-4005-abf5-d89f3ed256a3 req-25e29ecc-adbf-4bee-b76c-0c0833572a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b4933f-b046-47e9-a9a4-573fc8b2051d", "tag": "b09e9e25-4da7-47ac-b372-5b64995be76e"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:53.929732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-11b9a69a-aaaf-4005-abf5-d89f3ed256a3 req-25e29ecc-adbf-4bee-b76c-0c0833572a66 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:53.930294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-11b9a69a-aaaf-4005-abf5-d89f3ed256a3 req-25e29ecc-adbf-4bee-b76c-0c0833572a66 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:53.943853 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-11b9a69a-aaaf-4005-abf5-d89f3ed256a3 req-25e29ecc-adbf-4bee-b76c-0c0833572a66 service nova] Creating event network-changed:b09e9e25-4da7-47ac-b372-5b64995be76e for instance e2b4933f-b046-47e9-a9a4-573fc8b2051d on hv-cinder-83754 Jun 16 17:48:53.950072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-11b9a69a-aaaf-4005-abf5-d89f3ed256a3 req-25e29ecc-adbf-4bee-b76c-0c0833572a66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037009 Jun 16 17:48:53.951023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 330/666] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:48:54.107562 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:54.117165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:54.118994 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:54.121283 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f8b18468-1ff4-487a-a287-81a794aeca90 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.308829 Jun 16 17:48:54.131365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 337/667] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:53 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:54.955981 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1178706043", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "003c932a-79ef-4308-9a89-4be5c9bc35e8"}], "security_groups": [{"name": "tempest-securitygroup--97719872"}], "key_name": "tempest-keypair-1958829179", "user_data": "}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:55.059631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] validate_networks() for [('003c932a-79ef-4308-9a89-4be5c9bc35e8', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:48:55.139389 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:55.139949 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:55.146401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:55.146846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:55.147607 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:55.148042 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:55.442659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:55.450892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:55.452593 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:55.453862 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4cd7709d-3206-43cf-9450-a46e02433345 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1406 microversion: 2.20 time: 0.318593 Jun 16 17:48:55.464403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 338/668] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:55 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:55.652429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:48:55.652978 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:48:55.653542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:48:55.653958 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:48:55.654379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:48:55.663854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:55.664312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:55.665151 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:55.665593 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:55.682711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:48:55.686744 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Getting quotas for user 813dd0cf7e1d4724b903b358aaac1ea7 and project dd279f49cbd84e9f926aa6372a4728d4. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:48:55.697662 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:48:55.700004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:48:55.746597 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9c20aaa7-7620-48ed-ab07-09ce1abacf33 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.797108 Jun 16 17:48:55.747250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 331/669] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:48:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:48:55.757442 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6c2f801b-f0e1-4887-9b93-b5abefb7370b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:55.758050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6c2f801b-f0e1-4887-9b93-b5abefb7370b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:55.812232 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6c2f801b-f0e1-4887-9b93-b5abefb7370b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:55.819328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6c2f801b-f0e1-4887-9b93-b5abefb7370b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1238 microversion: 2.1 time: 0.065812 Jun 16 17:48:55.819903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 339/670] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:55 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:55.965946 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-0d0e5dd7-1c63-4e4c-8833-c7c8b58b4ea5 req-4402421f-9e96-4d18-9d84-bb5f64d883c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b4933f-b046-47e9-a9a4-573fc8b2051d", "tag": "b09e9e25-4da7-47ac-b372-5b64995be76e"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:55.974866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-0d0e5dd7-1c63-4e4c-8833-c7c8b58b4ea5 req-4402421f-9e96-4d18-9d84-bb5f64d883c1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:55.975310 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-0d0e5dd7-1c63-4e4c-8833-c7c8b58b4ea5 req-4402421f-9e96-4d18-9d84-bb5f64d883c1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:55.986749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-0d0e5dd7-1c63-4e4c-8833-c7c8b58b4ea5 req-4402421f-9e96-4d18-9d84-bb5f64d883c1 service nova] Creating event network-changed:b09e9e25-4da7-47ac-b372-5b64995be76e for instance e2b4933f-b046-47e9-a9a4-573fc8b2051d on hv-cinder-83754 Jun 16 17:48:55.992081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-0d0e5dd7-1c63-4e4c-8833-c7c8b58b4ea5 req-4402421f-9e96-4d18-9d84-bb5f64d883c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029788 Jun 16 17:48:55.992721 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 332/671] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:56.472028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:56.472675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:56.479306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:56.480006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:56.480851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:56.481463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:56.684148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:56.692755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:56.694257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:56.695410 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-64248c1d-0731-43a4-9f4c-e530199678f1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1599 microversion: 2.20 time: 0.228074 Jun 16 17:48:56.695969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 340/672] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:48:56 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:48:56.714838 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:56.715420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:56.722404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:56.722855 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:56.723610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:56.724045 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:56.800629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a3d21338-344c-4b69-88f8-10810bead058 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090374 Jun 16 17:48:56.801226 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 333/673] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Jun 16 17:48:56 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:48:56.836913 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:56.837526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:56.843829 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:56.844361 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:56.845195 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:56.845631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:56.911752 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:56.920584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f9c22850-72d8-4c3a-bb48-44b2fdd4b630 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1290 microversion: 2.1 time: 0.087373 Jun 16 17:48:56.921167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 341/674] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:56 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:57.939789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:57.940427 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:57.947004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:57.947462 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:57.948247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:57.948733 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:58.008366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-667d4bec-240b-43de-9b6a-c19c557b61c0 req-44a7f366-302f-424d-90e2-c3bf4bdd1b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:58.018337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-667d4bec-240b-43de-9b6a-c19c557b61c0 req-44a7f366-302f-424d-90e2-c3bf4bdd1b3f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:58.018797 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-667d4bec-240b-43de-9b6a-c19c557b61c0 req-44a7f366-302f-424d-90e2-c3bf4bdd1b3f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:58.027283 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:58.037182 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-667d4bec-240b-43de-9b6a-c19c557b61c0 req-44a7f366-302f-424d-90e2-c3bf4bdd1b3f service nova] Creating event network-changed:90e9b67c-83ca-4a1b-b4d9-2731c84f1413 for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 on hv-cinder-83754 Jun 16 17:48:58.044644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-34483a2e-8632-4887-94a8-8ba65c6434d3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1296 microversion: 2.1 time: 0.110025 Jun 16 17:48:58.045480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 334/675] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:57 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:58.057209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-667d4bec-240b-43de-9b6a-c19c557b61c0 req-44a7f366-302f-424d-90e2-c3bf4bdd1b3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052517 Jun 16 17:48:58.057836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 342/676] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:48:59.062264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:48:59.062896 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:48:59.070076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:59.070465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:59.071241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:59.071687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:59.467199 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:48:59.477546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-307e790e-a0ac-4250-bc44-7bcec5cedcdd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.419520 Jun 16 17:48:59.478134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 335/677] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:48:59 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:48:59.753505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-a0b04920-5be7-48b7-8533-8a08d8b182e8 req-222a8626-f79a-4fbc-ad81-3e1a61aff23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e448d804-18a7-404c-a58e-854b11c69801", "tag": "2e73b04a-b8a4-419d-9d0e-38dcdb9de74f"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:48:59.765875 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-a0b04920-5be7-48b7-8533-8a08d8b182e8 req-222a8626-f79a-4fbc-ad81-3e1a61aff23a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:48:59.766438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-a0b04920-5be7-48b7-8533-8a08d8b182e8 req-222a8626-f79a-4fbc-ad81-3e1a61aff23a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:48:59.784173 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-a0b04920-5be7-48b7-8533-8a08d8b182e8 req-222a8626-f79a-4fbc-ad81-3e1a61aff23a service nova] Creating event network-changed:2e73b04a-b8a4-419d-9d0e-38dcdb9de74f for instance e448d804-18a7-404c-a58e-854b11c69801 on hv-cinder-83754 Jun 16 17:48:59.789407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-a0b04920-5be7-48b7-8533-8a08d8b182e8 req-222a8626-f79a-4fbc-ad81-3e1a61aff23a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041508 Jun 16 17:48:59.790018 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 343/678] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:00.494551 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:00.495086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:00.501761 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:00.502203 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:00.502961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:00.503397 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:00.638565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:00.646536 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-12b5e06f-dca4-4d7b-b018-95d711401029 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.155870 Jun 16 17:49:00.647093 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 336/679] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:00 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:01.719894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:01.720660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:01.726903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:01.727355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:01.728121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:01.728592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:01.919497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:01.928188 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4c135f52-98fc-43c9-b702-dd10d4482f3a tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.268642 Jun 16 17:49:01.928798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 344/680] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:01 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:02.945240 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:02.945883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:02.952495 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:02.952951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:02.953947 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:02.954396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:02.958475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:03.085123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:03.092539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c603d6ba-f287-4c98-8b45-23ee73b2c250 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.151186 Jun 16 17:49:03.093099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 337/681] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:02 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:04.110223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:04.111285 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:04.118064 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:04.118528 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:04.119318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:04.119866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:04.254688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:04.262305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-49b55808-bb1c-48cc-baf7-d15beb40a4ac tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.156326 Jun 16 17:49:04.262872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 345/682] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:04 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:05.279974 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:05.280631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:05.287832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:05.288291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:05.289097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:05.289542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:05.415146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:05.423317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a138a6ac-32e9-4db1-9657-7a52b2f2f2b4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.147267 Jun 16 17:49:05.423882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 338/683] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:05 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:05.594083 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-2026c04d-9256-4a50-a3b5-791e1c74a1ab req-7e75da8b-e901-46df-8773-a4b88d234b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e448d804-18a7-404c-a58e-854b11c69801", "name": "network-vif-plugged", "status": "completed", "tag": "2e73b04a-b8a4-419d-9d0e-38dcdb9de74f"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:05.604049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-2026c04d-9256-4a50-a3b5-791e1c74a1ab req-7e75da8b-e901-46df-8773-a4b88d234b40 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:05.604539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-2026c04d-9256-4a50-a3b5-791e1c74a1ab req-7e75da8b-e901-46df-8773-a4b88d234b40 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:05.615657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-2026c04d-9256-4a50-a3b5-791e1c74a1ab req-7e75da8b-e901-46df-8773-a4b88d234b40 service nova] Creating event network-vif-plugged:2e73b04a-b8a4-419d-9d0e-38dcdb9de74f for instance e448d804-18a7-404c-a58e-854b11c69801 on hv-cinder-83754 Jun 16 17:49:05.620533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-2026c04d-9256-4a50-a3b5-791e1c74a1ab req-7e75da8b-e901-46df-8773-a4b88d234b40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030276 Jun 16 17:49:05.621205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 346/684] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:06.440361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:06.441200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:06.443658 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:06.444420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:06.445847 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:06.453327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:06.454029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:06.454809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:06.455264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:06.590314 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:06.598342 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-36bd4707-85b9-4e41-aa03-f8f648db460b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.162951 Jun 16 17:49:06.598901 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 339/685] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:06 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:07.612881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=6 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:07.617424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:07.618133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:07.624698 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:07.625677 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:07.626472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:07.626917 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:07.759688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:07.763349 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:07.768328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4aae32b3-0a9c-40bf-a8bd-f25f84629837 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1362 microversion: 2.1 time: 0.156534 Jun 16 17:49:07.768931 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 347/686] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:07 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:08.786059 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:08.786698 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:08.793271 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:08.793719 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:08.794482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:08.794916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:08.921922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:08.929775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4ee3dc97-0f2f-46df-9149-4204b6ceced4 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1548 microversion: 2.1 time: 0.147972 Jun 16 17:49:08.930340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 340/687] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:08 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:08.946521 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:08.947059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:08.954235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:08.954691 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:08.955469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:08.955917 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:09.033604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d81a14fe-5018-48d0-b7bb-0d624347c05d tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090914 Jun 16 17:49:09.034233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 348/688] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:49:08 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:09.952607 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-fcec4c0d-97a9-4371-9716-fbdac20de1b0 req-d8b6ee89-c5e3-4f5d-a8e8-ee5e02e9fda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e448d804-18a7-404c-a58e-854b11c69801", "tag": "2e73b04a-b8a4-419d-9d0e-38dcdb9de74f"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:09.962212 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-fcec4c0d-97a9-4371-9716-fbdac20de1b0 req-d8b6ee89-c5e3-4f5d-a8e8-ee5e02e9fda9 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:09.962656 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-fcec4c0d-97a9-4371-9716-fbdac20de1b0 req-d8b6ee89-c5e3-4f5d-a8e8-ee5e02e9fda9 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:09.976499 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-fcec4c0d-97a9-4371-9716-fbdac20de1b0 req-d8b6ee89-c5e3-4f5d-a8e8-ee5e02e9fda9 service nova] Creating event network-changed:2e73b04a-b8a4-419d-9d0e-38dcdb9de74f for instance e448d804-18a7-404c-a58e-854b11c69801 on hv-cinder-83754 Jun 16 17:49:09.981632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-fcec4c0d-97a9-4371-9716-fbdac20de1b0 req-d8b6ee89-c5e3-4f5d-a8e8-ee5e02e9fda9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032710 Jun 16 17:49:09.982236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 341/689] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:18.952468 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-610801139"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:18.953578 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:18.956111 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=26 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:18.961625 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:18.962079 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:18.962855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:18.963300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:19.092129 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.network.security_group_api [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Removing security group 3acd422d-5395-4af9-aade-8cb93b30c262 from port 6c162a6a-4074-4e87-ad30-96c62f1c9169 Jun 16 17:49:19.682889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a6b5e481-c618-4946-b41f-4e67612f9de5 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/action" status: 202 len: 0 microversion: 2.1 time: 0.734996 Jun 16 17:49:19.683506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 349/690] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:49:18 2022] POST /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:19.700218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-f56c0f17-b164-4498-94d8-a8de3bf136b9 req-1b6fa8a9-ad61-45f7-ada9-6fe8e30d18dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:19.724966 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-f56c0f17-b164-4498-94d8-a8de3bf136b9 req-1b6fa8a9-ad61-45f7-ada9-6fe8e30d18dc service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:19.725789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-f56c0f17-b164-4498-94d8-a8de3bf136b9 req-1b6fa8a9-ad61-45f7-ada9-6fe8e30d18dc service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:19.745916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-f56c0f17-b164-4498-94d8-a8de3bf136b9 req-1b6fa8a9-ad61-45f7-ada9-6fe8e30d18dc service nova] Creating event network-changed:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:49:19.753203 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-f56c0f17-b164-4498-94d8-a8de3bf136b9 req-1b6fa8a9-ad61-45f7-ada9-6fe8e30d18dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060948 Jun 16 17:49:19.754087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 342/691] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:21.060150 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:21.060698 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:21.062956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-06d4ffd6-250f-4c7f-8fed-201ea7fbba19 req-320fb744-768a-4df2-8825-a00343755bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:21.068199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:21.068686 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:21.069658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:21.070099 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:21.072283 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-06d4ffd6-250f-4c7f-8fed-201ea7fbba19 req-320fb744-768a-4df2-8825-a00343755bb3 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:21.072846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-06d4ffd6-250f-4c7f-8fed-201ea7fbba19 req-320fb744-768a-4df2-8825-a00343755bb3 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:21.084809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-06d4ffd6-250f-4c7f-8fed-201ea7fbba19 req-320fb744-768a-4df2-8825-a00343755bb3 service nova] Creating event network-changed:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:49:21.090051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-06d4ffd6-250f-4c7f-8fed-201ea7fbba19 req-320fb744-768a-4df2-8825-a00343755bb3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 Jun 16 17:49:21.090862 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 343/692] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:21.159442 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lazy-loading 'services' on Instance uuid 9f177e30-c276-411d-81cd-42ce35bee47a {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:21.246347 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cd04e70e-3f92-40c6-913a-23f48d5e5b5a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments/224aa8a4-b494-4f3d-88d8-c10f288bc0e5" status: 202 len: 0 microversion: 2.1 time: 0.190516 Jun 16 17:49:21.247657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 350/693] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:49:21 2022] DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments/224aa8a4-b494-4f3d-88d8-c10f288bc0e5 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:21.257640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:21.261470 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:21.273566 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:21.274999 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:21.276230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:21.277380 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:21.310770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ca601e68-7ff7-4470-9797-70643ad3114a tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057603 Jun 16 17:49:21.311803 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 344/694] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:21 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:22.323918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:22.325022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:22.333186 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:22.333870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:22.335037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:22.335797 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:22.377518 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-261eddf9-3647-4425-9dfc-cd33126a8899 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058385 Jun 16 17:49:22.378097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 351/695] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:22 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:23.390852 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:23.392945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:23.399396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:23.399848 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:23.400641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:23.401075 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:23.429896 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-42bf651d-6c71-4f96-bcb9-a87f6913283c tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043003 Jun 16 17:49:23.430445 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 345/696] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:23 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:49:23.441581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:23.442145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:23.449231 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:23.449683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:23.450451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:23.450891 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:23.535043 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] HTTP exception thrown: Instance 9f177e30-c276-411d-81cd-42ce35bee47a is not attached to volume 224aa8a4-b494-4f3d-88d8-c10f288bc0e5 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Request method failure captured: Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments/224aa8a4-b494-4f3d-88d8-c10f288bc0e5 HTTP/1.1 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2xyzvVClKwHG2jFjrVgGNv-aumMgak6j8g7FOfEK-TfAAM08dKLBImMH3yqvoTQDKjFo_gM5tB4lF_BCF54dTXi8wQ2H9ENiNdO-PlFTw23B_Z3KGjY2HiQ46DHpmW4pvGmY691Tf0gQvGXlb8AAD5ZZkdMmq8YarFGdOl7YK8BVOs Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: ac4c34d742f64d17b81d6a6171e66e84 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-TestMinimumBasicScenario-1627693996 Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:49:23.537385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac4c34d742f64d17b81d6a6171e66e84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ac4c34d742f64d17b81d6a6171e66e84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ac4c34d742f64d17b81d6a6171e66e84", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac4c34d742f64d17b81d6a6171e66e84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-TestMinimumBasicScenario-1627693996 Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: ac4c34d742f64d17b81d6a6171e66e84 Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1627693996 Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-TestMinimumBasicScenario-1627693996-project Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 03be2d45633949a7b416fc5a84b8f000 Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-TestMinimumBasicScenario-1627693996-project Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:49:23.539000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 9f177e30-c276-411d-81cd-42ce35bee47a is not attached to volume 224aa8a4-b494-4f3d-88d8-c10f288bc0e5 Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'server_id': '9f177e30-c276-411d-81cd-42ce35bee47a', 'id': '224aa8a4-b494-4f3d-88d8-c10f288bc0e5'} Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224aa8a4-b494-4f3d-88d8-c10f288bc0e5. Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:49:23.540005 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f177e30-c276-411d-81cd-42ce35bee47a is not attached to volume 224aa8a4-b494-4f3d-88d8-c10f288bc0e5 Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f177e30-c276-411d-81cd-42ce35bee47a is not attached to volume 224aa8a4-b494-4f3d-88d8-c10f288bc0e5 Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:23.541466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Returning 404 to user: Instance 9f177e30-c276-411d-81cd-42ce35bee47a is not attached to volume 224aa8a4-b494-4f3d-88d8-c10f288bc0e5 {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:49:23.542647 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-865a28aa-2805-42e2-ae92-da57613df9ff tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments/224aa8a4-b494-4f3d-88d8-c10f288bc0e5" status: 404 len: 154 microversion: 2.1 time: 0.102455 Jun 16 17:49:23.542647 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 352/697] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:49:23 2022] DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a/os-volume_attachments/224aa8a4-b494-4f3d-88d8-c10f288bc0e5 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:49:24.670383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:24.670881 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:24.677736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:24.678191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:24.678962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:24.679404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:24.705856 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:49:24.777697 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e5ba7efa-bdb5-4a10-b0ca-cd5d9c33c9e3 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 204 len: 0 microversion: 2.1 time: 0.110887 Jun 16 17:49:24.778261 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 346/698] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:49:24 2022] DELETE /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:49:24.786832 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:24.788039 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:24.794684 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:24.795135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:24.795901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:24.796341 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:24.927875 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:24.935474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e66a5fac-4386-4ac1-ac02-6da538c9c0fd tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1553 microversion: 2.1 time: 0.152761 Jun 16 17:49:24.936035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 353/699] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:24 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:25.365287 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:25.365863 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:25.371733 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:25.372179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:25.372983 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:25.373420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:25.396099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bb45c670-ca99-4b33-97b3-720832414b50 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/ips" status: 200 len: 150 microversion: 2.1 time: 0.090232 Jun 16 17:49:25.396755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 347/700] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:49:25 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:25.952452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:25.953105 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:25.962568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:25.963028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:25.963804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:25.964255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:26.098779 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:26.106230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6119e9b9-32c5-4e58-ac09-4332baa02efe tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1553 microversion: 2.1 time: 0.157704 Jun 16 17:49:26.106795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 354/701] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:25 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:26.716515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b4f3244-7211-4ee3-bf50-9d6a99c1ca36"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:26.717583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:26.724275 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:26.724763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:26.725531 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:26.725969 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:27.045076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-caefec76-ff73-4404-ab75-baf503ac6a41 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332243 Jun 16 17:49:27.045693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 348/702] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:49:26 2022] POST /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:27.122897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:27.123519 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:27.129973 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:27.130429 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:27.131199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:27.131641 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:27.258692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:27.266477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7242da77-018f-4e65-a50f-c59f24bed0c9 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1553 microversion: 2.1 time: 0.147416 Jun 16 17:49:27.267048 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 355/703] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:27 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:27.858753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-fce9fb3c-52cf-4fbd-a9f1-836e04d37a53 req-8766800b-17ed-42e1-bf6e-b6d0af357c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f177e30-c276-411d-81cd-42ce35bee47a", "name": "network-vif-deleted", "tag": "6c162a6a-4074-4e87-ad30-96c62f1c9169"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:27.868825 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-fce9fb3c-52cf-4fbd-a9f1-836e04d37a53 req-8766800b-17ed-42e1-bf6e-b6d0af357c8f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:27.869265 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-fce9fb3c-52cf-4fbd-a9f1-836e04d37a53 req-8766800b-17ed-42e1-bf6e-b6d0af357c8f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:27.881846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-fce9fb3c-52cf-4fbd-a9f1-836e04d37a53 req-8766800b-17ed-42e1-bf6e-b6d0af357c8f service nova] Creating event network-vif-deleted:6c162a6a-4074-4e87-ad30-96c62f1c9169 for instance 9f177e30-c276-411d-81cd-42ce35bee47a on hv-cinder-83754 Jun 16 17:49:27.887815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-fce9fb3c-52cf-4fbd-a9f1-836e04d37a53 req-8766800b-17ed-42e1-bf6e-b6d0af357c8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Jun 16 17:49:27.888576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 349/704] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:28.283054 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:28.283905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:28.290509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:28.290967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:28.291738 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:28.292182 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:28.321926 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:28.322383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:28.322836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lazy-loading 'fault' on Instance uuid 9f177e30-c276-411d-81cd-42ce35bee47a {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:28.362674 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03be2d45633949a7b416fc5a84b8f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4c34d742f64d17b81d6a6171e66e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:28.370085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-199379ec-871a-491e-8c67-c6e749dc2b8f tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 200 len: 1347 microversion: 2.1 time: 0.090922 Jun 16 17:49:28.370659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 356/705] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:28 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 1347 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:29.389331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:29.390025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] [instance: 9f177e30-c276-411d-81cd-42ce35bee47a] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:29.397188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:29.397636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:29.398388 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:29.398826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:29.412412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] HTTP exception thrown: Instance 9f177e30-c276-411d-81cd-42ce35bee47a could not be found. Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Request method failure captured: Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a HTTP/1.1 Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2xyzvVClKwHG2jFjrVgGNv-aumMgak6j8g7FOfEK-TfAAM08dKLBImMH3yqvoTQDKjFo_gM5tB4lF_BCF54dTXi8wQ2H9ENiNdO-PlFTw23B_Z3KGjY2HiQ46DHpmW4pvGmY691Tf0gQvGXlb8AAD5ZZkdMmq8YarFGdOl7YK8BVOs Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: ac4c34d742f64d17b81d6a6171e66e84 Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-TestMinimumBasicScenario-1627693996 Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:49:29.414023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac4c34d742f64d17b81d6a6171e66e84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ac4c34d742f64d17b81d6a6171e66e84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ac4c34d742f64d17b81d6a6171e66e84", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac4c34d742f64d17b81d6a6171e66e84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-TestMinimumBasicScenario-1627693996 Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: ac4c34d742f64d17b81d6a6171e66e84 Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1627693996 Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-TestMinimumBasicScenario-1627693996-project Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 03be2d45633949a7b416fc5a84b8f000 Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-TestMinimumBasicScenario-1627693996-project Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 9f177e30-c276-411d-81cd-42ce35bee47a could not be found. Jun 16 17:49:29.415605 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '9f177e30-c276-411d-81cd-42ce35bee47a'} Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f177e30-c276-411d-81cd-42ce35bee47a could not be found. Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:49:29.416426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f177e30-c276-411d-81cd-42ce35bee47a could not be found. Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f177e30-c276-411d-81cd-42ce35bee47a could not be found. Jun 16 17:49:29.417818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:29.419097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Returning 404 to user: Instance 9f177e30-c276-411d-81cd-42ce35bee47a could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:49:29.419097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f9fd7a41-2626-47fd-aa10-a4efd840ea57 tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a" status: 404 len: 111 microversion: 2.1 time: 0.031061 Jun 16 17:49:29.419097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 350/706] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:29 2022] GET /compute/v2.1/servers/9f177e30-c276-411d-81cd-42ce35bee47a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:49:29.424480 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-594b1d72-7c19-4b31-b636-4e607db4103d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] Calling method '.version_select at 0x7f287ff6e940>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:29.441950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-594b1d72-7c19-4b31-b636-4e607db4103d tempest-TestMinimumBasicScenario-1627693996 tempest-TestMinimumBasicScenario-1627693996-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-622938686" status: 202 len: 0 microversion: 2.1 time: 0.021517 Jun 16 17:49:29.442582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 357/707] 10.222.0.42 () {58 vars in 1268 bytes} [Thu Jun 16 17:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-622938686 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:35.090776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:35.091329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:35.098289 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.099017 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.099984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.100466 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.104907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:35.187766 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lazy-loading 'services' on Instance uuid e2b4933f-b046-47e9-a9a4-573fc8b2051d {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:35.270454 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cfe3a1db-3681-4a7b-8098-09c85de67816 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments/7492fc79-0643-4ebf-8546-35012e5b43d4" status: 202 len: 0 microversion: 2.1 time: 0.182693 Jun 16 17:49:35.275666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:49:35 2022] DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments/7492fc79-0643-4ebf-8546-35012e5b43d4 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:35.280755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:35.281703 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:35.296734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.297302 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.298237 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.299722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.345230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a3205726-5be7-430a-a9cb-6fac91412a51 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068645 Jun 16 17:49:35.346436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 358/709] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:35 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:49:35.636040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b4f3244-7211-4ee3-bf50-9d6a99c1ca36"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:35.637653 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:35.645298 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.645970 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.647128 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.647454 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.741316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Invalid volume: volume 8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 is already attached to instances: eab2d5df-1539-4e63-a3ee-269f6116bbb8 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: POST /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments HTTP/1.1 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 74 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:49:35.743564 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {"volumeAttachment": {"volumeId": "8b4f3244-7211-4ee3-bf50-9d6a99c1ca36"}} Jun 16 17:49:35.745189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Invalid volume: volume 8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 is already attached to instances: eab2d5df-1539-4e63-a3ee-269f6116bbb8 Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'server_id': 'eab2d5df-1539-4e63-a3ee-269f6116bbb8', 'body': {'volumeAttachment': {'volumeId': '8b4f3244-7211-4ee3-bf50-9d6a99c1ca36'}}} Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 is already attached to instances: eab2d5df-1539-4e63-a3ee-269f6116bbb8 Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:35.746738 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 is already attached to instances: eab2d5df-1539-4e63-a3ee-269f6116bbb8 Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:35.748103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:35.750056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:35.750056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:49:35.750056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:49:35.750056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 is already attached to instances: eab2d5df-1539-4e63-a3ee-269f6116bbb8 Jun 16 17:49:35.750056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:35.750056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 400 to user: Invalid volume: volume 8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 is already attached to instances: eab2d5df-1539-4e63-a3ee-269f6116bbb8 {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:49:35.751801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-163118f6-935a-4970-a9e4-4968a56674d6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119666 Jun 16 17:49:35.753404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 352/710] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:49:35 2022] POST /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:49:35.816870 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:35.817369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:35.823384 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.823835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.824634 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:35.825070 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:35.909428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lazy-loading 'services' on Instance uuid eab2d5df-1539-4e63-a3ee-269f6116bbb8 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:35.996788 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c63c251c-1c21-4b89-922d-c7add724354d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments/8b4f3244-7211-4ee3-bf50-9d6a99c1ca36" status: 202 len: 0 microversion: 2.1 time: 0.184610 Jun 16 17:49:35.997522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 359/711] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:49:35 2022] DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments/8b4f3244-7211-4ee3-bf50-9d6a99c1ca36 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:36.007271 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:36.008357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:36.020488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:36.021068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:36.022015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:36.022459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:36.066389 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-58b7765a-aff1-46b8-8da7-0b94f7df1e87 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063124 Jun 16 17:49:36.071268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 353/712] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:36 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:36.359697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:36.360851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:36.393132 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:36.393620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:36.394539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:36.395004 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:36.430179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ae24b232-734f-4950-afb3-4a0a1fda28ff tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075556 Jun 16 17:49:36.434175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 360/713] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:36 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:37.083207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:37.084170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:37.086648 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:37.091689 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.092153 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.092956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.093397 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.124507 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3e05b294-84d9-41a8-b305-876db488c170 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Jun 16 17:49:37.125280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 354/714] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:37 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:37.442759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:37.443867 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:37.451058 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.451506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.452268 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.452736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.482612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-898098c0-4ba0-48cb-8037-bb6393ebba4a tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044437 Jun 16 17:49:37.483197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 361/715] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:37 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:49:37.559601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:37.560279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:37.567323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.567841 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.568661 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.569133 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.594597 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:49:37.677628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-03dd07ad-a153-4e03-a3a6-b6b09bce9ea7 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 204 len: 0 microversion: 2.1 time: 0.123307 Jun 16 17:49:37.678393 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 355/716] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:49:37 2022] DELETE /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:49:37.688820 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:37.689975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:37.697552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.698166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.698946 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:37.699618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:37.845004 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:37.853839 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b9b53436-67b1-4229-a4db-e524509abfbd tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1690 microversion: 2.1 time: 0.169716 Jun 16 17:49:37.854438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 362/717] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:37 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:38.138298 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:38.139313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:38.147174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.147630 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.148434 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.148870 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.180694 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e4384f15-a492-4696-8325-c38be0e81c3f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046968 Jun 16 17:49:38.181565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 356/718] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:49:38 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:49:38.239723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:38.240226 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:38.246403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.246852 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.247612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.248066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.274498 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:49:38.300991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:38.352485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ea3d98f4-48f7-40e5-abfc-52d6ad85b088 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 204 len: 0 microversion: 2.1 time: 0.116810 Jun 16 17:49:38.353085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 363/719] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:49:38 2022] DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:49:38.361188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:38.362325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:38.368311 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.368800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.369567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.370007 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.500576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:38.508754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f8ba5669-7668-4802-995e-f8d758531abb tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1681 microversion: 2.1 time: 0.151294 Jun 16 17:49:38.509322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 357/720] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:38 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:38.871127 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:38.871755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:38.878321 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.878780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:38.879552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:38.879999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:39.014132 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:39.025475 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-02b53fa9-6a2c-42fd-b2da-f74a5db531b8 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1690 microversion: 2.1 time: 0.158653 Jun 16 17:49:39.026145 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 364/721] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:38 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:39.526664 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:39.527267 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:39.533737 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:39.534300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:39.535056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:39.535488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:39.663884 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:39.671322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-18e3f33d-2d93-408b-b5db-c441445a062e tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1681 microversion: 2.1 time: 0.148509 Jun 16 17:49:39.671885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 358/722] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:39 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:40.043125 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:40.043670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:40.051030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:40.051510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:40.052270 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:40.052744 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:40.184248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:40.192552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c2f4e5c9-02e4-4ad8-a9a3-9422c6ebb138 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1690 microversion: 2.1 time: 0.153343 Jun 16 17:49:40.193121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 365/723] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:40 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:40.688366 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:40.689008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:40.695722 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:40.696178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:40.696982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:40.697424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:40.831120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:40.838581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3252ee70-7df8-439d-ab77-9d8798457890 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1681 microversion: 2.1 time: 0.154084 Jun 16 17:49:40.839148 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 359/724] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:40 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:41.209418 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:41.210021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:41.216599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:41.217059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:41.217831 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:41.218276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:41.356687 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:41.365126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d2acd1e6-1f46-4f8f-8079-aa9ac34c4045 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1690 microversion: 2.1 time: 0.159631 Jun 16 17:49:41.366922 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 366/725] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:41 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:41.856106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:41.856688 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:41.864073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:41.864550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:41.865322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:41.865756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:41.995476 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:42.004113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d9336cc4-3b10-449c-8c52-f218e8e54a27 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1681 microversion: 2.1 time: 0.151766 Jun 16 17:49:42.004731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 360/726] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:41 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:42.381641 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:42.382160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:42.388887 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:42.389336 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:42.390096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:42.390529 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:42.519291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:42.526722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3ff30e21-23e7-4d18-bad0-e103587c4209 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1690 microversion: 2.1 time: 0.149003 Jun 16 17:49:42.527293 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:42 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:43.022925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:43.023538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:43.029973 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:43.030424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:43.031190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:43.031627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:43.167154 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:43.175134 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-61f7c8b5-c8b4-4a26-9346-8a657fa6233c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1681 microversion: 2.1 time: 0.156026 Jun 16 17:49:43.175692 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 361/728] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:43 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:43.542949 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:43.543586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:43.550635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:43.551080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:43.551844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:43.552281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:43.897616 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:43.905200 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-afa7ae4a-b896-427f-92f7-64f8244bde18 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1690 microversion: 2.1 time: 0.366083 Jun 16 17:49:43.905777 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 368/729] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:43 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1690 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:44.194609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:44.195231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:44.201863 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:44.202322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:44.203108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:44.203550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:44.557676 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:44.566977 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9ae7eaca-510b-4611-a600-4cd95914e7b3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1681 microversion: 2.1 time: 0.378389 Jun 16 17:49:44.567696 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 362/730] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:44 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1681 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:49:44.857328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:44.858184 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:44.866218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:44.866672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:44.867471 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:44.867921 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:44.898278 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8cc8c0a7-4047-40eb-b400-2e4363202a7b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/ips" status: 200 len: 153 microversion: 2.20 time: 0.330845 Jun 16 17:49:44.898763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 369/731] 10.222.0.42 () {60 vars in 1288 bytes} [Thu Jun 16 17:49:44 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/ips => generated 153 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:49:44.926007 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:44.926629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:44.933263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:44.933645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:44.934422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:44.935077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:45.199285 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:45.213826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0dcdee85-b302-4b35-bd0e-eb005be1e2e6 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1622 microversion: 2.1 time: 0.294066 Jun 16 17:49:45.215033 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 363/732] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:44 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1622 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:45.586189 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:45.586968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:45.604065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:45.606197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:45.607886 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:45.609696 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:45.660969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-053484f1-ab6b-4d93-aa14-d97192c8af6a req-c4f76347-4f3b-4d7c-bcac-fab60676da5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b4933f-b046-47e9-a9a4-573fc8b2051d", "name": "network-vif-deleted", "tag": "b09e9e25-4da7-47ac-b372-5b64995be76e"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:45.678514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-053484f1-ab6b-4d93-aa14-d97192c8af6a req-c4f76347-4f3b-4d7c-bcac-fab60676da5e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:45.685295 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-053484f1-ab6b-4d93-aa14-d97192c8af6a req-c4f76347-4f3b-4d7c-bcac-fab60676da5e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:45.708162 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-053484f1-ab6b-4d93-aa14-d97192c8af6a req-c4f76347-4f3b-4d7c-bcac-fab60676da5e service nova] Creating event network-vif-deleted:b09e9e25-4da7-47ac-b372-5b64995be76e for instance e2b4933f-b046-47e9-a9a4-573fc8b2051d on hv-cinder-83754 Jun 16 17:49:45.721525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:45.728315 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-053484f1-ab6b-4d93-aa14-d97192c8af6a req-c4f76347-4f3b-4d7c-bcac-fab60676da5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211928 Jun 16 17:49:45.729000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 370/733] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:45.731488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d92a854b-fcfc-42cf-b1ce-aba86b68ff7f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 200 len: 1326 microversion: 2.1 time: 0.149532 Jun 16 17:49:45.742749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 364/734] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:45 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:49:46.235063 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:46.235842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:46.242505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.242959 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.243740 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.244178 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.300689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.301159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.301630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lazy-loading 'fault' on Instance uuid e2b4933f-b046-47e9-a9a4-573fc8b2051d {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:46.355394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:46.363621 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f0f434b1-6921-4395-92f1-36d9ebfd2a53 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 200 len: 1335 microversion: 2.1 time: 0.132787 Jun 16 17:49:46.364808 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 371/735] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:46 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:46.748929 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:46.756161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:46.763135 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.763592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.764390 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.764851 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.778966 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 HTTP/1.1 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:49:46.780657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:49:46.782137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'eab2d5df-1539-4e63-a3ee-269f6116bbb8'} Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:49:46.782933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:49:46.785484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:46.786550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:49:46.786550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d31597b9-dae0-4426-83a9-25f903afaf23 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 404 len: 111 microversion: 2.1 time: 0.037528 Jun 16 17:49:46.786550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 365/736] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:46 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:49:46.791510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-28913c07-b602-4742-9460-d30d2d074917 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '.version_select at 0x7f287fff5310>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:46.809818 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-28913c07-b602-4742-9460-d30d2d074917 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676076866" status: 202 len: 0 microversion: 2.1 time: 0.021855 Jun 16 17:49:46.810504 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 372/737] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jun 16 17:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676076866 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:46.889205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:46.889845 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:46.896949 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.897506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.898282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:46.898724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:46.903218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:46.923398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lazy-loading 'flavor' on Instance uuid 78c1089a-2ab6-49c7-b121-93d0c558bd11 {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:47.215005 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-40ecd6c0-faee-415c-b519-ae64be428414 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/action" status: 202 len: 0 microversion: 2.20 time: 0.330090 Jun 16 17:49:47.215826 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 366/738] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jun 16 17:49:46 2022] POST /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:49:47.225769 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:47.226410 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:47.234701 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:47.235840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:47.236842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:47.237305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:47.382188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:47.383073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: e2b4933f-b046-47e9-a9a4-573fc8b2051d] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:47.389874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:47.390417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:47.391314 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:47.391819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:47.406201 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] HTTP exception thrown: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d could not be found. Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Request method failure captured: Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d HTTP/1.1 Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vpZMBWfbYYv8MskhFdjKunGOLOW3u46steyppa9ycLucosvadyy1Z0Cv9eZXLnn_X3B2oENgqUbBw9XTYlK3LNrIJYCU0DEweCvNQ371qBo0NWO_5UsoOBIgnqL8VFksWOCaQC_FuMMCVDggwNXjJTZxjC8vzksPKbFTPoqIRSPFc Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:49:47.407931 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feb571d68c6c4a1ab9e7b175f5a6e0b3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 268c5947a265492bb7a8f181f9f5c504 Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d could not be found. Jun 16 17:49:47.410144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'e2b4933f-b046-47e9-a9a4-573fc8b2051d'} Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d could not be found. Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:49:47.410849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d could not be found. Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d could not be found. Jun 16 17:49:47.411985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:49:47.413053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Returning 404 to user: Instance e2b4933f-b046-47e9-a9a4-573fc8b2051d could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:49:47.413053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ac0d9e9d-dd09-4084-87f5-b96c2b497588 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d" status: 404 len: 111 microversion: 2.1 time: 0.032633 Jun 16 17:49:47.413053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 367/739] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:47 2022] GET /compute/v2.1/servers/e2b4933f-b046-47e9-a9a4-573fc8b2051d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:49:47.418874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-47f3ff13-05d2-4614-bbb2-13a5a1373d67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '.version_select at 0x7f288c139160>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:47.437504 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-47f3ff13-05d2-4614-bbb2-13a5a1373d67 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340433655" status: 202 len: 0 microversion: 2.1 time: 0.022290 Jun 16 17:49:47.438818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 368/740] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jun 16 17:49:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340433655 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:49:47.490446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:47.499373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:47.501061 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:47.502896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-49d0b91a-7b07-4cd8-8ad0-adff4bc27e82 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.281812 Jun 16 17:49:47.503715 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 373/741] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:47 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:47.551073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3341ef4c-8988-4f31-9cce-dd74b7d66afd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: .version_select at 0x7f288c0c4dc0>, body: {"keypair": {"name": "tempest-keypair-1609944648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFwrBi9EqW+j/6wGlaJs/V1yB1b71SxbjQY6AaIWkS0MrbFJaJtfeiL2MA8zGzaYh0oTpjs9u/Lehqz5JB4jIQJQPq+XNqB+AvlgP65yGtEGg5wbEhUpmcjGA96pdI2w=="}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:47.566643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-3341ef4c-8988-4f31-9cce-dd74b7d66afd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:49:47.570554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-3341ef4c-8988-4f31-9cce-dd74b7d66afd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:49:47.593762 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3341ef4c-8988-4f31-9cce-dd74b7d66afd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047054 Jun 16 17:49:47.593947 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 369/742] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:49:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:47.746734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-3d6e0b33-52f9-439f-81a7-e6653f044e30 req-f28fd4c0-946b-413f-9bd7-0b3fbfddfd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab2d5df-1539-4e63-a3ee-269f6116bbb8", "name": "network-vif-deleted", "tag": "58b55dc3-484d-43c6-a29e-6468b7b97a54"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:47.760032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3d6e0b33-52f9-439f-81a7-e6653f044e30 req-f28fd4c0-946b-413f-9bd7-0b3fbfddfd48 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:47.761342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3d6e0b33-52f9-439f-81a7-e6653f044e30 req-f28fd4c0-946b-413f-9bd7-0b3fbfddfd48 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:47.778035 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-3d6e0b33-52f9-439f-81a7-e6653f044e30 req-f28fd4c0-946b-413f-9bd7-0b3fbfddfd48 service nova] Creating event network-vif-deleted:58b55dc3-484d-43c6-a29e-6468b7b97a54 for instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 on hv-cinder-83754 Jun 16 17:49:47.783256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-3d6e0b33-52f9-439f-81a7-e6653f044e30 req-f28fd4c0-946b-413f-9bd7-0b3fbfddfd48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042057 Jun 16 17:49:47.784529 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 374/743] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:49:48.522119 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:48.522732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:48.531392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:48.531856 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:48.532735 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:48.533679 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:48.763062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:48.772309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:48.773985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:48.775149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-eabff716-08fa-48f6-8dac-db97e0e277de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.257718 Jun 16 17:49:48.775697 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 370/744] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:48 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:49.008588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-53394650", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73e06f90-3f8b-46da-a984-8f18b234443c"}], "security_groups": [{"name": "tempest-securitygroup--1361658691"}], "key_name": "tempest-keypair-1609944648", "user_data": "}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:49.015829 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:49.123207 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] validate_networks() for [('73e06f90-3f8b-46da-a984-8f18b234443c', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:49:49.629941 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:49:49.630375 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:49:49.630856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:49:49.631273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:49:49.631688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:49:49.641052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:49.641508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:49.642629 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:49.643700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:49.661085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:49:49.665054 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Getting quotas for user 8fff53cb0d084d9284825488f6843ee4 and project 4cf380fb2e904569b24c6212d88ac621. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:49:49.675969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:49:49.678477 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:49:49.724693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-99fac3ca-9f78-4ef1-801c-bbd0a07bc896 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720513 Jun 16 17:49:49.725257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 375/745] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:49:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:49:49.735198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-94a14390-e930-4b05-98f5-5e3087f7bbe3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:49.735804 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-94a14390-e930-4b05-98f5-5e3087f7bbe3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:49.791382 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-94a14390-e930-4b05-98f5-5e3087f7bbe3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:49.794131 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:49.794753 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:49.798073 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-94a14390-e930-4b05-98f5-5e3087f7bbe3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1240 microversion: 2.1 time: 0.066660 Jun 16 17:49:49.801486 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:49.801934 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:49.802702 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:49.803138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:49.808216 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 371/746] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:49 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:49.945152 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:49.953357 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:49.954851 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:49.956933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a95706eb-3429-4d96-9c0d-5aa48b5f9b40 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.167044 Jun 16 17:49:49.957488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 376/747] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:49 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:50.358482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:50.358982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:50.365542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.365998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.366773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.367221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.394111 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:49:50.473293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a06928ec-b77d-4b6a-b821-f4ed843038c9 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 204 len: 0 microversion: 2.1 time: 0.118356 Jun 16 17:49:50.474661 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 372/748] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:49:50 2022] DELETE /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:49:50.482526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:50.483154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:50.490558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.491367 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.492811 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.493503 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.642212 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:50.652756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c8184a55-72bb-4ce8-af62-0f451cc02f0e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1507 microversion: 2.1 time: 0.174123 Jun 16 17:49:50.653344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 377/749] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:50 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:50.816652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:50.817363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:50.829141 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.829634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.830606 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.831192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.897633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:50.905315 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2451454f-34e8-4860-b8be-09ed087edb5f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1292 microversion: 2.1 time: 0.093845 Jun 16 17:49:50.906191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 373/750] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:50 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:50.976143 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:50.976786 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:50.983135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.983623 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:50.984554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:50.984998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:51.118588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:51.126973 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:51.128764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:51.129931 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0dc18fe2-7b46-4301-b0de-9847275e6934 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.158243 Jun 16 17:49:51.130494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 378/751] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:50 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:51.669989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:51.670670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:51.677125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:51.677580 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:51.678353 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:51.678796 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:51.810663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:51.819418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8d5dc2bb-d330-4ada-812c-23ad05a011db tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1507 microversion: 2.1 time: 0.153291 Jun 16 17:49:51.820023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 374/752] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:51 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:51.923517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:51.924606 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:51.930731 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:51.931181 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:51.931947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:51.932405 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:51.993266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:52.000597 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bddd592a-460b-4d9a-9819-3812345858bc tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1292 microversion: 2.1 time: 0.081099 Jun 16 17:49:52.001159 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 379/753] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:51 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:52.147874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:52.148529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:52.155049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:52.155510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:52.156278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:52.156748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:52.295975 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:52.304744 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:52.306250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:52.307407 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e670677c-5f4f-45d9-a311-c76aa8888bf5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.163577 Jun 16 17:49:52.307964 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 375/754] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:52 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:49:52.836619 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:52.837392 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:52.843481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:52.844014 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:52.844880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:52.845330 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:53.019778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:53.020454 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:53.026584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:53.027168 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:53.027951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:53.028415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:53.125424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:53.133444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-44bc9308-b75c-40d5-8730-1f3e4b51ad7e tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1507 microversion: 2.1 time: 0.300762 Jun 16 17:49:53.134020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 380/755] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:52 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:53.156173 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:53.167812 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-dd320297-5f36-4392-bc1b-65cbdda0f6ed tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1298 microversion: 2.1 time: 0.153627 Jun 16 17:49:53.168419 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 376/756] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:53 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:49:53.325963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:53.326835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:53.334762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:53.335230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:53.336015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:53.336512 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:53.523727 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-a36583a5-bc10-43e1-9ce3-7e506215e647 req-a58499d7-40c9-4e90-b9e9-63f17bc137a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d06d37-30c0-455b-b00a-bc4b9311be03", "name": "network-vif-deleted", "tag": "af63ecca-47fb-44c6-a4ae-a10a439cdfda"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:53.532568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-a36583a5-bc10-43e1-9ce3-7e506215e647 req-a58499d7-40c9-4e90-b9e9-63f17bc137a0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:53.533083 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-a36583a5-bc10-43e1-9ce3-7e506215e647 req-a58499d7-40c9-4e90-b9e9-63f17bc137a0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:53.554223 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-a36583a5-bc10-43e1-9ce3-7e506215e647 req-a58499d7-40c9-4e90-b9e9-63f17bc137a0 service nova] Creating event network-vif-deleted:af63ecca-47fb-44c6-a4ae-a10a439cdfda for instance 63d06d37-30c0-455b-b00a-bc4b9311be03 on hv-cinder-83754 Jun 16 17:49:53.563514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-a36583a5-bc10-43e1-9ce3-7e506215e647 req-a58499d7-40c9-4e90-b9e9-63f17bc137a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046342 Jun 16 17:49:53.565416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 377/757] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:53.632449 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:53.645027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:53.646991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:53.648176 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a13d92f8-93b8-4610-a158-86c814b7560b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.326463 Jun 16 17:49:53.648768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 381/758] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:53 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:49:54.151467 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:54.153072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:54.161614 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.162315 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.163710 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.164392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.186274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:54.187047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:54.204205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.206254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.209024 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.210551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.225194 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.225992 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.226724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lazy-loading 'fault' on Instance uuid 63d06d37-30c0-455b-b00a-bc4b9311be03 {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:49:54.240500 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:54.287507 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:54.294864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cfba209e-4641-4802-8fbe-debbc878aba5 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 200 len: 1312 microversion: 2.1 time: 0.147589 Jun 16 17:49:54.295440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 378/759] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:54 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:54.667013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:54.667631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:54.674571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.675137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.675936 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:54.676394 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:54.865681 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:54.871889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c2bb53f2-731f-4bcb-a89b-64ec1929c721 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.690275 Jun 16 17:49:54.872490 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 382/760] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:54 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:55.041690 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:55.057959 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:55.059956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:55.061180 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8cbd5b9d-dba3-4776-9284-609830ba12ad tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.398157 Jun 16 17:49:55.061745 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 379/761] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:54 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:49:55.310978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:55.311592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: 63d06d37-30c0-455b-b00a-bc4b9311be03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:55.319049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.319495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.320261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.320730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.336663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] HTTP exception thrown: Instance 63d06d37-30c0-455b-b00a-bc4b9311be03 could not be found. Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Request method failure captured: Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 HTTP/1.1 Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpZMBWfbYYv8MskhFdjKunGOLOW3u46steyppa9ycLucosvadyy1Z0Cv9eZXLnn_X3B2oENgqUbBw9XTYlK3LNrIJYCU0DEweCvNQ371qBo0NWO_5UsoOBIgnqL8VFksWOCaQC_FuMMCVDggwNXjJTZxjC8vzksPKbFTPoqIRSPFc Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:49:55.338133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feb571d68c6c4a1ab9e7b175f5a6e0b3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 268c5947a265492bb7a8f181f9f5c504 Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 63d06d37-30c0-455b-b00a-bc4b9311be03 could not be found. Jun 16 17:49:55.339530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '63d06d37-30c0-455b-b00a-bc4b9311be03'} Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d06d37-30c0-455b-b00a-bc4b9311be03 could not be found. Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:49:55.340303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d06d37-30c0-455b-b00a-bc4b9311be03 could not be found. Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d06d37-30c0-455b-b00a-bc4b9311be03 could not be found. Jun 16 17:49:55.342032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:49:55.343144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Returning 404 to user: Instance 63d06d37-30c0-455b-b00a-bc4b9311be03 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:49:55.343144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6748db12-84cd-4636-bd01-13196d72198c tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03" status: 404 len: 111 microversion: 2.1 time: 0.032449 Jun 16 17:49:55.343144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 383/762] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:55 2022] GET /compute/v2.1/servers/63d06d37-30c0-455b-b00a-bc4b9311be03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:49:55.348948 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:55.349520 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:55.356711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.357178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.357975 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.358422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.387705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:49:55.474083 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-68989e03-ab08-459a-89f5-50c8ea046bfe tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 204 len: 0 microversion: 2.1 time: 0.129220 Jun 16 17:49:55.475038 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 380/763] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:49:55 2022] DELETE /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:49:55.482896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:55.483454 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:55.496902 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.497742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.498088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.498533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.681825 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-7213f95b-e13f-4794-a41d-5cd3512d6c91 req-e19fdfea-46f2-4f2e-83ae-23de7e78b824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfb15f8-5d0c-459a-ab9e-b8c603f5d276", "tag": "02b46b01-4ff5-4684-9280-acb28c448c4b"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:55.690979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-7213f95b-e13f-4794-a41d-5cd3512d6c91 req-e19fdfea-46f2-4f2e-83ae-23de7e78b824 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.691516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-7213f95b-e13f-4794-a41d-5cd3512d6c91 req-e19fdfea-46f2-4f2e-83ae-23de7e78b824 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.705553 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-7213f95b-e13f-4794-a41d-5cd3512d6c91 req-e19fdfea-46f2-4f2e-83ae-23de7e78b824 service nova] Creating event network-changed:02b46b01-4ff5-4684-9280-acb28c448c4b for instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 on hv-cinder-83754 Jun 16 17:49:55.710944 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-7213f95b-e13f-4794-a41d-5cd3512d6c91 req-e19fdfea-46f2-4f2e-83ae-23de7e78b824 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033362 Jun 16 17:49:55.711615 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 381/764] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:55.723289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:55.731295 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b7795616-f01a-48c4-ac60-39e6fa48e0d1 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.252211 Jun 16 17:49:55.731893 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 384/765] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:55 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:55.889524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:55.890229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:55.897200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.897654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.898418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:55.898859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:55.902829 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:56.035783 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:56.043289 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3ef2c01e-4660-45b3-a61e-d8880631bcac tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.158215 Jun 16 17:49:56.043853 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 382/766] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:55 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:56.078945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:56.079595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:56.086700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:56.087158 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:56.087931 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:56.088386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:56.215116 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:56.223270 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:56.224805 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:56.225967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-14ad8b59-0599-44a6-9e21-b04df0e2a05d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.150957 Jun 16 17:49:56.226517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 385/767] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:56 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:56.332574 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:56.333002 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:56.339097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:56.339549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:56.340317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:56.340786 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:56.365559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ebe90dcf-fdc0-4ead-aa71-ff4ed0808fe3 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/ips" status: 200 len: 146 microversion: 2.1 time: 0.037617 Jun 16 17:49:56.366148 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 383/768] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:49:56 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:56.747697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:56.748321 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:56.755453 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:56.755591 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:56.756660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:56.757195 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:56.892845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:56.900587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f9d7a55e-c8d0-45f2-8492-bd75cbfcee4b tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.156704 Jun 16 17:49:56.901183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 386/769] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:56 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:57.060583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:57.061198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:57.067463 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.067916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.068833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.069281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.197273 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:57.205561 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bc1d91d2-45ce-4190-ab80-0f555fd32c03 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.148360 Jun 16 17:49:57.206736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 384/770] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:57 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:57.244264 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:57.244920 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:57.251101 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.251552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.252799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.253257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.384424 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:57.393307 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:57.395062 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:57.396236 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5ea5d7c6-229f-44c2-98b2-d0ca850a5887 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.156084 Jun 16 17:49:57.396888 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 387/771] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:57 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:57.680055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44e7388a-974e-466f-a7c3-a1c941fa6539"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:57.681218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:57.687619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.688076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.689909 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.690552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.918136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:57.918756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:57.925522 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.925979 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:57.926752 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:57.927196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:58.093214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:58.101775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4c448c18-561c-4ae3-86cc-410f20a9ddd4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1521 microversion: 2.1 time: 0.187454 Jun 16 17:49:58.102345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 388/772] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:57 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:58.223654 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:58.224217 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:58.230282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:58.230738 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:58.231506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:58.231950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:58.363013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:58.370861 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-52649d52-3137-4996-b035-0211d11e15e8 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.151730 Jun 16 17:49:58.371431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 389/773] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:58 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:49:58.414380 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:58.414977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:58.420764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:58.421211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:58.421983 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:58.422414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:58.577644 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-29d61389-86b8-41e0-b496-c7e7f993d21b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901261 Jun 16 17:49:58.578449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 385/774] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:49:57 2022] POST /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:49:58.740956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:58.749243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:58.750810 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:58.752044 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-aeda9f22-fe7e-4cb3-9ad3-a6281e757cbf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.341292 Jun 16 17:49:58.752846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 390/775] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:58 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:49:59.122364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:59.123669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:59.133200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.135954 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.136818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.137267 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.216741 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-33f687f9-7ae8-4a99-ae91-0e39e522c6c2 req-97f96d00-5dc9-44e2-9bd2-e3b6c5dd1cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d948b628-6612-4dc0-adb7-2ba4bffc810c", "name": "network-vif-deleted", "tag": "6b353818-db5f-43c7-9236-5239f9413599"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:49:59.226669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-33f687f9-7ae8-4a99-ae91-0e39e522c6c2 req-97f96d00-5dc9-44e2-9bd2-e3b6c5dd1cce service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.227432 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-33f687f9-7ae8-4a99-ae91-0e39e522c6c2 req-97f96d00-5dc9-44e2-9bd2-e3b6c5dd1cce service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.241854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-33f687f9-7ae8-4a99-ae91-0e39e522c6c2 req-97f96d00-5dc9-44e2-9bd2-e3b6c5dd1cce service nova] Creating event network-vif-deleted:6b353818-db5f-43c7-9236-5239f9413599 for instance d948b628-6612-4dc0-adb7-2ba4bffc810c on hv-cinder-83754 Jun 16 17:49:59.242224 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268c5947a265492bb7a8f181f9f5c504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb571d68c6c4a1ab9e7b175f5a6e0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:59.246874 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-33f687f9-7ae8-4a99-ae91-0e39e522c6c2 req-97f96d00-5dc9-44e2-9bd2-e3b6c5dd1cce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Jun 16 17:49:59.247497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 391/776] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:49:59.250047 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2fd18209-7570-4d6f-bf99-a628789a9f74 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 200 len: 1479 microversion: 2.1 time: 0.132158 Jun 16 17:49:59.250788 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 386/777] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:59 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 1479 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:59.389367 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:59.390076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:59.396632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.397089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.397877 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.398319 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.536588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:49:59.544257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5f150ce0-cdc2-4bf5-a82c-7e238dce346a tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.159358 Jun 16 17:49:59.545007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 392/778] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:49:59 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:49:59.771442 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:49:59.772071 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:49:59.774569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:59.780972 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.781743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.782590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:49:59.783287 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:49:59.801442 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:00.001689 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:00.010458 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:00.012199 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:00.013382 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-80c084b2-905b-4854-ac34-05e75d059d08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.246737 Jun 16 17:50:00.013936 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 387/779] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:49:59 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:00.268088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:00.268723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] [instance: d948b628-6612-4dc0-adb7-2ba4bffc810c] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:00.270653 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:00.271394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=6 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:00.277605 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:00.278059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:00.278802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:00.279234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:00.295657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] HTTP exception thrown: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c could not be found. Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Request method failure captured: Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c HTTP/1.1 Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpZMBWfbYYv8MskhFdjKunGOLOW3u46steyppa9ycLucosvadyy1Z0Cv9eZXLnn_X3B2oENgqUbBw9XTYlK3LNrIJYCU0DEweCvNQ371qBo0NWO_5UsoOBIgnqL8VFksWOCaQC_FuMMCVDggwNXjJTZxjC8vzksPKbFTPoqIRSPFc Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:50:00.299474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feb571d68c6c4a1ab9e7b175f5a6e0b3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feb571d68c6c4a1ab9e7b175f5a6e0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: feb571d68c6c4a1ab9e7b175f5a6e0b3 Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1601962586 Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 268c5947a265492bb7a8f181f9f5c504 Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1601962586-project Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c could not be found. Jun 16 17:50:00.301505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'd948b628-6612-4dc0-adb7-2ba4bffc810c'} Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c could not be found. Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:00.302382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c could not be found. Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c could not be found. Jun 16 17:50:00.303791 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:00.305160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] Returning 404 to user: Instance d948b628-6612-4dc0-adb7-2ba4bffc810c could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:00.305160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-64ad7331-1148-40ac-910f-a25e4e6c32c4 tempest-ServerRescueNegativeTestJSON-1601962586 tempest-ServerRescueNegativeTestJSON-1601962586-project] 10.222.0.42 "GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c" status: 404 len: 111 microversion: 2.1 time: 0.036874 Jun 16 17:50:00.305160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 393/780] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:00 2022] GET /compute/v2.1/servers/d948b628-6612-4dc0-adb7-2ba4bffc810c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:00.561484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:00.562104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:00.573477 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:00.573940 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:00.574732 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:00.575187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:00.711108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:00.718539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fbf38fce-7440-4616-ab4e-b3af08822efa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.160912 Jun 16 17:50:00.719113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 388/781] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:00 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:01.032264 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:01.033151 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:01.040171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:01.040672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:01.041452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:01.041898 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:01.179483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:01.187514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:01.189180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:01.190981 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ccfa3c3e-3362-406e-b943-8bf72a5854a4 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.162114 Jun 16 17:50:01.191622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 394/782] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:01 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:01.735460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:01.736085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:01.742948 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:01.743419 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:01.744206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:01.744671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:01.908323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:01.916132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8bad5e4b-f204-4085-b6ed-e65cf4cedb2c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.184501 Jun 16 17:50:01.917004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 389/783] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:01 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:02.211208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:02.212672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:02.224179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:02.226149 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:02.227731 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:02.228449 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:02.369209 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:02.377439 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:02.378985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:02.380268 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-34d4dba2-fbe4-4bed-bba4-4bed827d0277 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.174498 Jun 16 17:50:02.380984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 395/784] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:02 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:02.933472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:02.933990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:02.941103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:02.941643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:02.942414 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:02.942849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:03.101920 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:03.110262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0401c0fa-4612-46ea-ac79-db0e8c40644b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.180707 Jun 16 17:50:03.122373 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 390/785] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:02 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:03.400977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:03.406168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:03.416551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:03.417232 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:03.419334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:03.420006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:03.563845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:03.573185 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:03.574767 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:03.576162 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a370a0ca-836e-4b8d-ba63-3af64fee09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1745 microversion: 2.20 time: 0.180605 Jun 16 17:50:03.576824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 396/786] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:03 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:04.131236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:04.131937 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:04.140907 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:04.141692 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:04.142672 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:04.144492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:04.313071 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:04.321424 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-51f37668-02aa-48a6-926a-7f43b16f4af3 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.196791 Jun 16 17:50:04.322654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 391/787] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:04 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:04.393255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-0b0b9aeb-15b5-4e76-9cdd-d435c2553365 req-2f1311a2-4c15-4738-895d-1ab62881f35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfb15f8-5d0c-459a-ab9e-b8c603f5d276", "name": "network-vif-plugged", "status": "completed", "tag": "02b46b01-4ff5-4684-9280-acb28c448c4b"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:04.402135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-0b0b9aeb-15b5-4e76-9cdd-d435c2553365 req-2f1311a2-4c15-4738-895d-1ab62881f35e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:04.403260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-0b0b9aeb-15b5-4e76-9cdd-d435c2553365 req-2f1311a2-4c15-4738-895d-1ab62881f35e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:04.418015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-0b0b9aeb-15b5-4e76-9cdd-d435c2553365 req-2f1311a2-4c15-4738-895d-1ab62881f35e service nova] Creating event network-vif-plugged:02b46b01-4ff5-4684-9280-acb28c448c4b for instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 on hv-cinder-83754 Jun 16 17:50:04.423338 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-0b0b9aeb-15b5-4e76-9cdd-d435c2553365 req-2f1311a2-4c15-4738-895d-1ab62881f35e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221237 Jun 16 17:50:04.424263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 397/788] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:04.594884 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:04.595578 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:04.607103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:04.608308 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:04.609530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:04.610050 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:04.795065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:04.804598 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:04.806094 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:04.807245 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-81f9391d-f9de-4d9d-8333-2e0353524e39 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1745 microversion: 2.20 time: 0.216267 Jun 16 17:50:04.807790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 392/789] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:04 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:04.916819 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d110b816-8f2b-4b81-af68-1839861cc593 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Action: 'create', calling method: .version_select at 0x7f287ff5b040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-319941327", "metadata": {"Type": "work"}}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d110b816-8f2b-4b81-af68-1839861cc593 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Request method failure captured: Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 121 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq21MPFib7ITtJFrxH0xtxBw4y-aHiifObi3mS5r11RFXS6OV9gcoski_AMS_cUdAWERmwDMGjec3R9X9sReL5dPhkkT-WOKCpkMTrXEwkftD1GirhkYq9j57-I1k2B2NRplmpZVvGzzKIe51jpSYPHdCcmXyKhqbtw72O0YTCWzMnN8 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:50:04.937795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818b250f052347ea90f850675c2976c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818b250f052347ea90f850675c2976c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: efc81237995e45cface80f5f9bd19c3e Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-319941327", "metadata": {"Type": "work"}}} Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:50:04.939121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-319941327', 'metadata': {'Type': 'work'}}}} Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:04.940059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:50:04.941754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:50:04.943120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:50:04.943120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.943120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d110b816-8f2b-4b81-af68-1839861cc593 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:04.943120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d110b816-8f2b-4b81-af68-1839861cc593 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134584 Jun 16 17:50:04.943120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 398/790] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jun 16 17:50:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 17:50:04.950367 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d0c39208-11b5-4477-8415-676fabc4e6bc tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Action: 'create', calling method: .version_select at 0x7f288c047310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1404732402", "metadata": {"Type": "work"}}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d0c39208-11b5-4477-8415-676fabc4e6bc tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Request method failure captured: Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 120 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq21MPFib7ITtJFrxH0xtxBw4y-aHiifObi3mS5r11RFXS6OV9gcoski_AMS_cUdAWERmwDMGjec3R9X9sReL5dPhkkT-WOKCpkMTrXEwkftD1GirhkYq9j57-I1k2B2NRplmpZVvGzzKIe51jpSYPHdCcmXyKhqbtw72O0YTCWzMnN8 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:04.953748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818b250f052347ea90f850675c2976c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818b250f052347ea90f850675c2976c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: efc81237995e45cface80f5f9bd19c3e Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1404732402", "metadata": {"Type": "work"}}} Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: Jun 16 17:50:04.955079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1404732402', 'metadata': {'Type': 'work'}}}} Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi '0' Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:04.956603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:50:04.958159 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:50:04.959492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:50:04.959492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.959492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d0c39208-11b5-4477-8415-676fabc4e6bc tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:04.959492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d0c39208-11b5-4477-8415-676fabc4e6bc tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008721 Jun 16 17:50:04.959492 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 393/791] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jun 16 17:50:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:50:04.964737 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a69a6863-23d0-4acc-a026-20da6f6967b2 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Action: 'create', calling method: .version_select at 0x7f288c097a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1988921642", "metadata": {"Type": "work"}}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a69a6863-23d0-4acc-a026-20da6f6967b2 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Request method failure captured: Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 119 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq21MPFib7ITtJFrxH0xtxBw4y-aHiifObi3mS5r11RFXS6OV9gcoski_AMS_cUdAWERmwDMGjec3R9X9sReL5dPhkkT-WOKCpkMTrXEwkftD1GirhkYq9j57-I1k2B2NRplmpZVvGzzKIe51jpSYPHdCcmXyKhqbtw72O0YTCWzMnN8 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:50:04.967118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818b250f052347ea90f850675c2976c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818b250f052347ea90f850675c2976c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: efc81237995e45cface80f5f9bd19c3e Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1988921642", "metadata": {"Type": "work"}}} Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:50:04.968694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1988921642', 'metadata': {'Type': 'work'}}}} Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi '' Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:04.973746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:50:04.975394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:50:04.976807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:50:04.976807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:04.976807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a69a6863-23d0-4acc-a026-20da6f6967b2 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:04.976807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a69a6863-23d0-4acc-a026-20da6f6967b2 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007528 Jun 16 17:50:04.976807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 399/792] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jun 16 17:50:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 17:50:04.977916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c14f1f9e-4ed7-4f7a-94c7-ea9fbc9033da tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Calling method '.version_select at 0x7f288c037d30>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:05.006975 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-c14f1f9e-4ed7-4f7a-94c7-ea9fbc9033da tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] HTTP exception thrown: Volume tempest-invalid-287868060 could not be found. Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c14f1f9e-4ed7-4f7a-94c7-ea9fbc9033da tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Request method failure captured: Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-287868060 HTTP/1.1 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq21MPFib7ITtJFrxH0xtxBw4y-aHiifObi3mS5r11RFXS6OV9gcoski_AMS_cUdAWERmwDMGjec3R9X9sReL5dPhkkT-WOKCpkMTrXEwkftD1GirhkYq9j57-I1k2B2NRplmpZVvGzzKIe51jpSYPHdCcmXyKhqbtw72O0YTCWzMnN8 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:05.011596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818b250f052347ea90f850675c2976c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818b250f052347ea90f850675c2976c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: efc81237995e45cface80f5f9bd19c3e Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Volume tempest-invalid-287868060 could not be found. Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'tempest-invalid-287868060'} Jun 16 17:50:05.012995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-287868060 could not be found. (HTTP 404) (Request-ID: req-0da2491d-5739-4dde-a575-744b617d00ed) Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.013755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:50:05.015418 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-287868060 could not be found. Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:05.017372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-287868060 could not be found. Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-287868060 could not be found. Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c14f1f9e-4ed7-4f7a-94c7-ea9fbc9033da tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Returning 404 to user: Volume tempest-invalid-287868060 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c14f1f9e-4ed7-4f7a-94c7-ea9fbc9033da tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-287868060" status: 404 len: 98 microversion: 2.1 time: 0.038893 Jun 16 17:50:05.019770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 394/793] 10.222.0.42 () {58 vars in 1214 bytes} [Thu Jun 16 17:50:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-287868060 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 17:50:05.026134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0ad9ed0a-0e36-44e1-ae10-1c3b50af6f50 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004484 Jun 16 17:50:05.026632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 400/794] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Jun 16 17:50:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 17:50:05.036949 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-56df6678-6c04-436a-9087-a490a88686e2 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003860 Jun 16 17:50:05.037444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 395/795] 10.222.0.42 () {58 vars in 1136 bytes} [Thu Jun 16 17:50:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 17:50:05.048882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-62bb9857-a532-42f8-878e-8f299057d5d0 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Calling method '.version_select at 0x7f287ff5be50>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:05.079316 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-62bb9857-a532-42f8-878e-8f299057d5d0 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] HTTP exception thrown: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-62bb9857-a532-42f8-878e-8f299057d5d0 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Request method failure captured: Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/os-volumes/a2d9f48c-7ed7-4982-874d-66d37202ad6f HTTP/1.1 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq21MPFib7ITtJFrxH0xtxBw4y-aHiifObi3mS5r11RFXS6OV9gcoski_AMS_cUdAWERmwDMGjec3R9X9sReL5dPhkkT-WOKCpkMTrXEwkftD1GirhkYq9j57-I1k2B2NRplmpZVvGzzKIe51jpSYPHdCcmXyKhqbtw72O0YTCWzMnN8 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:50:05.083889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818b250f052347ea90f850675c2976c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818b250f052347ea90f850675c2976c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: efc81237995e45cface80f5f9bd19c3e Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'a2d9f48c-7ed7-4982-874d-66d37202ad6f'} Jun 16 17:50:05.085488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. (HTTP 404) (Request-ID: req-7f33adb5-01e5-4875-aa91-d038d4e3be0b) Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.087248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:50:05.088689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:50:05.089747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-62bb9857-a532-42f8-878e-8f299057d5d0 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Returning 404 to user: Volume a2d9f48c-7ed7-4982-874d-66d37202ad6f could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-62bb9857-a532-42f8-878e-8f299057d5d0 tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/a2d9f48c-7ed7-4982-874d-66d37202ad6f" status: 404 len: 109 microversion: 2.1 time: 0.040383 Jun 16 17:50:05.090940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 401/796] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:50:05 2022] DELETE /compute/v2.1/os-volumes/a2d9f48c-7ed7-4982-874d-66d37202ad6f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:05.095166 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b117f9c6-e25a-449e-9227-993508ac4ead tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Calling method '.version_select at 0x7f288c10e940>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:05.123919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-b117f9c6-e25a-449e-9227-993508ac4ead tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] HTTP exception thrown: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b117f9c6-e25a-449e-9227-993508ac4ead tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Request method failure captured: Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/os-volumes/0c9f23b8-2a09-4de8-b4d2-d0695bc37030 HTTP/1.1 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq21MPFib7ITtJFrxH0xtxBw4y-aHiifObi3mS5r11RFXS6OV9gcoski_AMS_cUdAWERmwDMGjec3R9X9sReL5dPhkkT-WOKCpkMTrXEwkftD1GirhkYq9j57-I1k2B2NRplmpZVvGzzKIe51jpSYPHdCcmXyKhqbtw72O0YTCWzMnN8 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:05.125878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818b250f052347ea90f850675c2976c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818b250f052347ea90f850675c2976c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818b250f052347ea90f850675c2976c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 818b250f052347ea90f850675c2976c3 Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-VolumesNegativeTest-1870620529 Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: efc81237995e45cface80f5f9bd19c3e Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-VolumesNegativeTest-1870620529-project Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '0c9f23b8-2a09-4de8-b4d2-d0695bc37030'} Jun 16 17:50:05.127385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. (HTTP 404) (Request-ID: req-17997720-408a-47b8-ac5d-6c955932618f) Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.129351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:50:05.130787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:50:05.132711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b117f9c6-e25a-449e-9227-993508ac4ead tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] Returning 404 to user: Volume 0c9f23b8-2a09-4de8-b4d2-d0695bc37030 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b117f9c6-e25a-449e-9227-993508ac4ead tempest-VolumesNegativeTest-1870620529 tempest-VolumesNegativeTest-1870620529-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0c9f23b8-2a09-4de8-b4d2-d0695bc37030" status: 404 len: 109 microversion: 2.1 time: 0.035935 Jun 16 17:50:05.134127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 396/797] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:50:05 2022] GET /compute/v2.1/os-volumes/0c9f23b8-2a09-4de8-b4d2-d0695bc37030 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:50:05.341266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:05.342175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:05.349728 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:05.350179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:05.350948 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:05.351386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:05.486368 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:05.504444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-786ff679-95a9-4504-aaf9-fef8149edeab tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.168067 Jun 16 17:50:05.505045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 402/798] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:05 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:05.826053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:05.827293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:05.833654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:05.834148 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:05.834990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:05.835381 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:06.019994 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:06.030209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:06.031920 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:06.035260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b5b071fc-96c4-49d2-b746-deec3d62beaa tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1745 microversion: 2.20 time: 0.211893 Jun 16 17:50:06.047446 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 397/799] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:05 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:06.439399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-2ede174e-6a3e-4d11-bc0b-7b3c845c4060 req-948d9cf6-9d2f-4379-aa68-c05366e0dc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "name": "network-vif-plugged", "status": "completed", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:06.451241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-2ede174e-6a3e-4d11-bc0b-7b3c845c4060 req-948d9cf6-9d2f-4379-aa68-c05366e0dc73 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:06.451763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-2ede174e-6a3e-4d11-bc0b-7b3c845c4060 req-948d9cf6-9d2f-4379-aa68-c05366e0dc73 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:06.464622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-2ede174e-6a3e-4d11-bc0b-7b3c845c4060 req-948d9cf6-9d2f-4379-aa68-c05366e0dc73 service nova] Creating event network-vif-plugged:90e9b67c-83ca-4a1b-b4d9-2731c84f1413 for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 on hv-cinder-83754 Jun 16 17:50:06.470677 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-2ede174e-6a3e-4d11-bc0b-7b3c845c4060 req-948d9cf6-9d2f-4379-aa68-c05366e0dc73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035362 Jun 16 17:50:06.472640 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 403/800] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:06.521942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:06.522557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:06.528834 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:06.529284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:06.530056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:06.530497 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:06.669413 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:06.677798 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-037b8dcf-53bf-4c5e-90d6-2a6b1e59deef tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1366 microversion: 2.1 time: 0.160030 Jun 16 17:50:06.678410 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 398/801] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:06 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:07.056508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:07.057330 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:07.063746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.064196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.065079 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.065805 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.217804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:07.242432 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:07.243960 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:07.245492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b9872413-e212-441c-9dd8-b9eb9990d007 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.194578 Jun 16 17:50:07.246652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 404/802] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:07 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:07.249622 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:07.250623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:07.257929 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.258637 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.259633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.260071 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.294773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-eae0c2f3-e5c1-47f7-aab4-23d1989112c9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Jun 16 17:50:07.295967 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 399/803] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:50:07 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:50:07.307398 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:07.308039 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:07.314695 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.315904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.316940 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.317613 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.352768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e6a47709-48f6-4f46-a965-077d2142f508 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/44e7388a-974e-466f-a7c3-a1c941fa6539" status: 200 len: 194 microversion: 2.1 time: 0.050791 Jun 16 17:50:07.355528 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 405/804] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jun 16 17:50:07 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/44e7388a-974e-466f-a7c3-a1c941fa6539 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:07.703016 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:07.704844 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:07.712116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.712645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.713755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.715270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.877389 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:07.890208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c30782d4-a378-4851-bbe9-3ad726d7439c tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1555 microversion: 2.1 time: 0.192617 Jun 16 17:50:07.890788 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 400/805] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:07 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:07.907172 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:07.907672 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:07.914827 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.915505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.916557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:07.917006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:07.935820 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=100 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:08.004092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-df5b7c1b-03c9-44e9-bdee-8dbff91c45fe tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100757 Jun 16 17:50:08.004707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 406/806] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jun 16 17:50:07 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:50:08.265535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:08.266574 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:08.274080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:08.275157 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:08.276179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:08.276866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:08.815494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "748dfda2-6fbf-4f47-a1c3-ae0687a1ae8b"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:08.817401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:08.825469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:08.826167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:08.827297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:08.828031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:08.955009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:08.958988 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:08.970060 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:08.972065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:08.973893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a68f5089-b9ce-4252-b73b-2adbde17cad2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.712431 Jun 16 17:50:08.975146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 401/807] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:08 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:09.327192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-61860439-6b62-446c-974b-9e4ed47cee6f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "POST /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518261 Jun 16 17:50:09.336911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 407/808] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:50:08 2022] POST /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:09.701775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-846d51f3-bc3e-4221-9406-e252c8993c1f req-cabc2766-97cd-4d5a-b66f-85e9dbcc1020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfb15f8-5d0c-459a-ab9e-b8c603f5d276", "tag": "02b46b01-4ff5-4684-9280-acb28c448c4b"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:09.722933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-846d51f3-bc3e-4221-9406-e252c8993c1f req-cabc2766-97cd-4d5a-b66f-85e9dbcc1020 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:09.723749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-846d51f3-bc3e-4221-9406-e252c8993c1f req-cabc2766-97cd-4d5a-b66f-85e9dbcc1020 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:09.739126 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-846d51f3-bc3e-4221-9406-e252c8993c1f req-cabc2766-97cd-4d5a-b66f-85e9dbcc1020 service nova] Creating event network-changed:02b46b01-4ff5-4684-9280-acb28c448c4b for instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 on hv-cinder-83754 Jun 16 17:50:09.745519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-846d51f3-bc3e-4221-9406-e252c8993c1f req-cabc2766-97cd-4d5a-b66f-85e9dbcc1020 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050434 Jun 16 17:50:09.746667 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 402/809] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:10.004943 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:10.006243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:10.014622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:10.020314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:10.025528 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:10.035626 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:10.314308 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:10.323297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:10.324911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:10.326096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a4bd04d4-6094-41b9-91cd-62260f57f0d1 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.326679 Jun 16 17:50:10.334632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 408/810] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:09 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:11.348059 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:11.349641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:11.356054 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:11.356487 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:11.357257 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:11.357885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:11.516449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:11.526181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:11.530583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:11.531985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-22cb33db-506c-4403-b532-e395b2d92dbe tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.190220 Jun 16 17:50:11.532754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 403/811] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:11 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:12.554892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:12.557148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:12.564241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:12.564725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:12.566239 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:12.566683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:12.734611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:12.742975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:12.744495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:12.745878 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-74484e0b-fd9c-4732-ad36-cee2141b09d5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.198739 Jun 16 17:50:12.746598 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 409/812] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:12 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:50:13.779266 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:13.779894 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:13.792035 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:13.792521 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:13.793422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:13.794110 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:13.945880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:13.955190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:13.957783 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:13.959106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7f5d22cc-7353-4c0f-8857-b2c995ac32fb tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.195025 Jun 16 17:50:13.960074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 404/813] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:13 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:14.977542 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:14.978774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:14.986037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:14.987092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:14.988287 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:14.988820 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:15.157436 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:15.167150 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:15.168858 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:15.170034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-caa5aebc-0774-43c1-acc9-680ee20e7dc9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.196426 Jun 16 17:50:15.170912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 410/814] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:14 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:16.189221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:16.191729 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:16.199246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:16.200458 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:16.200941 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:16.201961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:16.357853 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:16.368322 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:16.370901 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:16.372507 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1290dc23-bf31-4dcc-95ac-82151399fee6 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.187413 Jun 16 17:50:16.373374 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 405/815] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:16 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:17.025798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:17.026795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:17.033135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.035069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.036192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.037002 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.083234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-01a8c547-3dc9-488c-9d99-fd0554e6e41b tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061437 Jun 16 17:50:17.084096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 411/816] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:50:17 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:17.225339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:17.226350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:17.235174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.235649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.236592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.237743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.272852 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f02e4b65-8868-4fc0-91b6-8297c55abe86 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/44e7388a-974e-466f-a7c3-a1c941fa6539" status: 200 len: 194 microversion: 2.1 time: 0.053485 Jun 16 17:50:17.273657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 406/817] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jun 16 17:50:17 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/44e7388a-974e-466f-a7c3-a1c941fa6539 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:17.283245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:17.284620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:17.291047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.291610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.292639 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.294721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.387894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lazy-loading 'services' on Instance uuid e448d804-18a7-404c-a58e-854b11c69801 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:50:17.396263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:17.397235 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:17.404631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.405202 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.406218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:17.406773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:17.486271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e2708b17-2a8d-44a7-a5e7-198f4573dae0 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/44e7388a-974e-466f-a7c3-a1c941fa6539" status: 202 len: 0 microversion: 2.1 time: 0.206516 Jun 16 17:50:17.491289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 412/818] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:50:17 2022] DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/44e7388a-974e-466f-a7c3-a1c941fa6539 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:50:17.590020 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:17.599075 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:17.600950 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:17.602192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8203fe9d-7fac-4353-82a7-50549d15ff46 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1740 microversion: 2.20 time: 0.213747 Jun 16 17:50:17.602754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 407/819] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:17 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:50:18.622511 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:18.623221 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:18.631248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:18.631788 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:18.632727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:18.633181 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:18.767050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:18.775803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:18.777332 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:18.778495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-84dfc16d-0484-492c-8be3-77b644fa352d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1722 microversion: 2.20 time: 0.160734 Jun 16 17:50:18.779056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 413/820] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:18 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:19.673816 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:19.674309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:19.681242 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:19.681691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:19.682458 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:19.682893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:19.712756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ea20e033-cef9-4130-a43c-b86442c059e9 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/748dfda2-6fbf-4f47-a1c3-ae0687a1ae8b" status: 200 len: 194 microversion: 2.1 time: 0.042779 Jun 16 17:50:19.713354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 408/821] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jun 16 17:50:19 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/748dfda2-6fbf-4f47-a1c3-ae0687a1ae8b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:19.723660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:19.724289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:19.726954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:19.733318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:19.733813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:19.734756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:19.735274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:19.797152 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:19.797859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:19.805895 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:19.806514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:19.807451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:19.807889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:19.829354 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lazy-loading 'services' on Instance uuid e448d804-18a7-404c-a58e-854b11c69801 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:50:19.911124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-419eaa14-c69f-443b-87f5-8f7f30d6d1f6 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/748dfda2-6fbf-4f47-a1c3-ae0687a1ae8b" status: 202 len: 0 microversion: 2.1 time: 0.191708 Jun 16 17:50:19.911902 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 414/822] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:50:19 2022] DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments/748dfda2-6fbf-4f47-a1c3-ae0687a1ae8b => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:50:19.968906 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:19.977200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:19.978725 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:19.979893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2b8ff919-916f-4911-9b28-e4d625000aaf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1722 microversion: 2.20 time: 0.186691 Jun 16 17:50:19.980481 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 409/823] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:19 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:50:20.998111 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:20.998817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:21.007105 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:21.007913 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:21.010458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:21.010458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:21.319592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:21.327489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:21.329070 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:21.330317 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8b6d4a23-2d23-42aa-b40a-3ad068743acf tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1722 microversion: 2.20 time: 0.336459 Jun 16 17:50:21.330869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 415/824] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:20 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:22.084624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-ea6b0618-20cd-4a08-9e5c-60cfccbc6205 req-739e8403-cd6b-48d2-8e08-bc9b91aacc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "name": "network-vif-unplugged", "status": "completed", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:22.096157 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-ea6b0618-20cd-4a08-9e5c-60cfccbc6205 req-739e8403-cd6b-48d2-8e08-bc9b91aacc04 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.097857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-ea6b0618-20cd-4a08-9e5c-60cfccbc6205 req-739e8403-cd6b-48d2-8e08-bc9b91aacc04 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.113681 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.compute.server_external_events [req-ea6b0618-20cd-4a08-9e5c-60cfccbc6205 req-739e8403-cd6b-48d2-8e08-bc9b91aacc04 service nova] Unable to find a host for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11. Dropping event network-vif-unplugged {{(pid=124158) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 17:50:22.114575 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-ea6b0618-20cd-4a08-9e5c-60cfccbc6205 req-739e8403-cd6b-48d2-8e08-bc9b91aacc04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034433 Jun 16 17:50:22.115160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 410/825] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 17:50:22.198220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:22.198220 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:22.201344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.201803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.202578 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.203019 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.234138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5020eefc-3ae4-4534-9d24-90357b417144 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044632 Jun 16 17:50:22.234706 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 416/826] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:50:22 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:50:22.343805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:22.345951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:22.350634 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:22.351297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:22.353103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.353557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.354596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.355233 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.358019 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.358479 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.359267 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.359711 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.390230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a971271e-7de3-44e1-b29c-805ab30287d5 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051820 Jun 16 17:50:22.391015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 411/827] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:50:22 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:50:22.457190 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:22.458872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:22.466715 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.467426 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.468395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.469038 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.508724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:50:22.560183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:22.570933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:22.572723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:22.575012 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-629e95f9-1350-4b0a-ba72-2c11efa349dd tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1665 microversion: 2.20 time: 0.228608 Jun 16 17:50:22.575743 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 417/828] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:22 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1665 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:22.593963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c993fe4-b154-437d-8bb2-37695f3c0fad"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:22.595354 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:22.603365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.604255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.605142 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.605657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.608184 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1b09a43f-bd02-4436-89ed-c8f60841f6f2 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 204 len: 0 microversion: 2.1 time: 0.155789 Jun 16 17:50:22.609188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 412/829] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:50:22 2022] DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:50:22.619044 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:22.619765 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:22.627929 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.629149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.630087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:22.630696 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:22.774250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:22.782581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3865e5f3-c8aa-4be0-8281-edd933bf82d7 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1673 microversion: 2.1 time: 0.167630 Jun 16 17:50:22.783153 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 413/830] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:22 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:50:22.868002 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:22.882115 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8250dbc7-24c6-4d28-98c6-4e4a262d120f tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292227 Jun 16 17:50:22.882758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 418/831] 10.222.0.42 () {62 vars in 1363 bytes} [Thu Jun 16 17:50:22 2022] POST /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:50:23.005575 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:23.006069 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:23.012511 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.012955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.013711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.014146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.265474 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ed831eb5-bcb3-4a2c-836c-552c61f59d2d tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-volume_attachments/0c993fe4-b154-437d-8bb2-37695f3c0fad" status: 202 len: 0 microversion: 2.20 time: 0.264810 Jun 16 17:50:23.266138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 414/832] 10.222.0.42 () {60 vars in 1456 bytes} [Thu Jun 16 17:50:22 2022] DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-volume_attachments/0c993fe4-b154-437d-8bb2-37695f3c0fad => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:50:23.321867 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:23.322467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:23.329371 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.329817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.330575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.331006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.421727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-aa2ad2d9-7f66-442a-8aa8-80ce2cb6f194 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "POST /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/action" status: 202 len: 0 microversion: 2.20 time: 0.103757 Jun 16 17:50:23.422384 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 419/833] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jun 16 17:50:23 2022] POST /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:50:23.432029 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:23.433012 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:23.439232 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.439691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.440487 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.440940 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.466002 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:23.582072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:23.590247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:23.591769 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:23.592965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-668976b6-70a3-4b26-8087-124a2c9a7f47 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1673 microversion: 2.20 time: 0.164803 Jun 16 17:50:23.593531 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 415/834] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:23 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:23.801464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:23.802121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:23.809037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.809497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:23.810277 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:23.811050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:24.030763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:24.039646 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-13722453-6379-4f72-bd3b-e1fc60c0c096 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1673 microversion: 2.1 time: 0.242380 Jun 16 17:50:24.040208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 420/835] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:23 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:24.612538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:24.613211 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:24.619597 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:24.620116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:24.620919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:24.621355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:24.752735 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:24.762875 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:24.764390 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:24.765552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fe349cf5-68ae-4752-b233-6ef6207f0e08 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1673 microversion: 2.20 time: 0.157073 Jun 16 17:50:24.766122 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 416/836] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:24 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:25.062021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:25.064093 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:25.074945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:25.075401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:25.076446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:25.076895 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:25.356161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:25.364899 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-065028d8-9f05-48da-abb8-7546c0fe0ffd tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1673 microversion: 2.1 time: 0.310714 Jun 16 17:50:25.365478 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 421/837] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:25 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:25.785633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:25.786203 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:25.793070 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:25.793528 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:25.794321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:25.794769 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:26.141997 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:26.151374 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:26.152945 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:26.154214 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-79581236-326e-43b9-a387-47b88f173ae7 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.373036 Jun 16 17:50:26.154778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 417/838] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:25 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:26.382318 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:26.382930 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:26.389967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:26.390463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:26.391444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:26.391880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:26.528447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-32acd88c-0393-41b8-be35-891d0f232b49 req-c155218c-6635-40ab-bf46-1c16e92a71e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e448d804-18a7-404c-a58e-854b11c69801", "name": "network-vif-deleted", "tag": "2e73b04a-b8a4-419d-9d0e-38dcdb9de74f"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:26.530309 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813dd0cf7e1d4724b903b358aaac1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd279f49cbd84e9f926aa6372a4728d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:26.539021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-32acd88c-0393-41b8-be35-891d0f232b49 req-c155218c-6635-40ab-bf46-1c16e92a71e2 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:26.539880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-32acd88c-0393-41b8-be35-891d0f232b49 req-c155218c-6635-40ab-bf46-1c16e92a71e2 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:26.544972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2616261b-61c9-4a5d-b17d-8526656930d1 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 200 len: 1607 microversion: 2.1 time: 0.166554 Jun 16 17:50:26.545682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 422/839] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:26 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 1607 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:50:26.564076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-32acd88c-0393-41b8-be35-891d0f232b49 req-c155218c-6635-40ab-bf46-1c16e92a71e2 service nova] Creating event network-vif-deleted:2e73b04a-b8a4-419d-9d0e-38dcdb9de74f for instance e448d804-18a7-404c-a58e-854b11c69801 on hv-cinder-83754 Jun 16 17:50:26.571702 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-32acd88c-0393-41b8-be35-891d0f232b49 req-c155218c-6635-40ab-bf46-1c16e92a71e2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046821 Jun 16 17:50:26.572622 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 418/840] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:50:27.173401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:27.174018 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:27.181001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:27.181456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:27.193937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:27.194420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:27.366467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:27.385423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:27.388765 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:27.392881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c3eeeb5a-f6fa-40f6-9c46-d0469a63047e tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.221180 Jun 16 17:50:27.393600 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 423/841] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:27 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:27.569879 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:27.578782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:27.594460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:27.594923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:27.595716 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:27.596162 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:27.631100 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] HTTP exception thrown: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Request method failure captured: Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 HTTP/1.1 Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vgR8n1COjIKtBoDmaAKwtDUbsGHd2ekfio9Gck7tClkdpH7TQzLKJJYefcWxDdy-N7KCnTXNuAUp631tr55OYrYK89HYWxgv-7q_HqIl67U6bwIbTmDNpDuktlD2xPkyJZw3ZfeEJqU9qmyZ5w4MiICbjoDtV5-TvIC0XvjGyo6XI Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:27.636914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd279f49cbd84e9f926aa6372a4728d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 813dd0cf7e1d4724b903b358aaac1ea7 Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:27.638586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'e448d804-18a7-404c-a58e-854b11c69801'} Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:27.639506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:27.641030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:27.645287 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Returning 404 to user: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:27.648608 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-741ec0a1-6218-4330-a50b-d5de45ebb91f tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 404 len: 111 microversion: 2.1 time: 0.088636 Jun 16 17:50:27.652470 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 419/842] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:27 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:27.657638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6c30f79a-0546-4655-b496-f75b65c05aaf tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '.version_select at 0x7f287ff97820>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:27.704143 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6c30f79a-0546-4655-b496-f75b65c05aaf tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958829179" status: 202 len: 0 microversion: 2.1 time: 0.050055 Jun 16 17:50:27.720780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 424/843] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jun 16 17:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958829179 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:50:28.411789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:28.412416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:28.431833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:28.432288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:28.433107 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:28.433548 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:28.704874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:28.721263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:28.724563 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:28.731087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-23756cb1-270c-43f3-978c-ec3ee9bc8d59 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.320719 Jun 16 17:50:28.731087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 420/844] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:28 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:29.748716 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:29.750215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:29.759489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:29.759946 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:29.762305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:29.762305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:29.930086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:29.939746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:29.944195 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:29.946171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4caa3183-2afa-4249-834f-d656d4e7995b tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.201929 Jun 16 17:50:29.946709 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 425/845] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:29 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:30.955456 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:30.955996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:30.961433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:30.966761 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:30.967380 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:30.967857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:30.968515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:30.969486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:30.969929 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:30.979903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:30.980364 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:30.981176 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:30.981625 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:30.985810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] HTTP exception thrown: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Request method failure captured: Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 HTTP/1.1 Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vgR8n1COjIKtBoDmaAKwtDUbsGHd2ekfio9Gck7tClkdpH7TQzLKJJYefcWxDdy-N7KCnTXNuAUp631tr55OYrYK89HYWxgv-7q_HqIl67U6bwIbTmDNpDuktlD2xPkyJZw3ZfeEJqU9qmyZ5w4MiICbjoDtV5-TvIC0XvjGyo6XI Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:30.987444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd279f49cbd84e9f926aa6372a4728d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 813dd0cf7e1d4724b903b358aaac1ea7 Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:30.988979 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'e448d804-18a7-404c-a58e-854b11c69801'} Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:30.989930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:30.991441 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:30.993161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Returning 404 to user: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:30.993161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5981bd37-48ba-4c11-9bb4-8d692306c17e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 404 len: 111 microversion: 2.1 time: 0.037437 Jun 16 17:50:30.993161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 421/846] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:50:30 2022] DELETE /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:30.997496 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:30.998309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: e448d804-18a7-404c-a58e-854b11c69801] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:31.005205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:31.005910 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:31.006899 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:31.007344 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:31.024095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] HTTP exception thrown: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Request method failure captured: Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 HTTP/1.1 Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vgR8n1COjIKtBoDmaAKwtDUbsGHd2ekfio9Gck7tClkdpH7TQzLKJJYefcWxDdy-N7KCnTXNuAUp631tr55OYrYK89HYWxgv-7q_HqIl67U6bwIbTmDNpDuktlD2xPkyJZw3ZfeEJqU9qmyZ5w4MiICbjoDtV5-TvIC0XvjGyo6XI Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:31.026581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd279f49cbd84e9f926aa6372a4728d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 813dd0cf7e1d4724b903b358aaac1ea7 Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:31.028106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'e448d804-18a7-404c-a58e-854b11c69801'} Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:31.029013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. Jun 16 17:50:31.030359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:31.032284 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Returning 404 to user: Instance e448d804-18a7-404c-a58e-854b11c69801 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:31.033339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6bdc0add-bbcd-4067-9599-5970f4180e3e tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801" status: 404 len: 111 microversion: 2.1 time: 0.039527 Jun 16 17:50:31.038379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 422/847] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:30 2022] GET /compute/v2.1/servers/e448d804-18a7-404c-a58e-854b11c69801 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:31.185971 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:31.194918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:31.196437 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:31.197610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-15a2f95c-28e7-4bdf-92ca-52ca4d186650 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.235351 Jun 16 17:50:31.198171 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 426/848] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:30 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:50:32.216589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:32.217340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:32.224232 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:32.224742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:32.225572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:32.226018 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:32.374264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:32.386565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:32.388455 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:32.390288 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-039ae9fc-9b84-4e1e-bc27-e6b231c8f66a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.177800 Jun 16 17:50:32.391902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 423/849] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:32 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:33.413656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:33.414263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:33.420897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:33.421349 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:33.422114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:33.422554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:33.568161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:33.577683 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:33.579211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:33.580470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dd8bff02-59d0-47ca-a383-8e372e078397 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.171417 Jun 16 17:50:33.581280 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 427/850] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:33 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:34.306370 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:34.306887 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:34.313415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:34.313867 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:34.314631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:34.315067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:34.338741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] HTTP exception thrown: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Request method failure captured: Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 HTTP/1.1 Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vgR8n1COjIKtBoDmaAKwtDUbsGHd2ekfio9Gck7tClkdpH7TQzLKJJYefcWxDdy-N7KCnTXNuAUp631tr55OYrYK89HYWxgv-7q_HqIl67U6bwIbTmDNpDuktlD2xPkyJZw3ZfeEJqU9qmyZ5w4MiICbjoDtV5-TvIC0XvjGyo6XI Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:50:34.340330 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd279f49cbd84e9f926aa6372a4728d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 813dd0cf7e1d4724b903b358aaac1ea7 Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.341736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '6228596e-39a4-457c-bdad-6fb60dc046f6'} Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:34.342489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.344178 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.346723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Returning 404 to user: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:34.346723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-db6bc067-1437-417e-97ee-12f80e37c515 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 404 len: 111 microversion: 2.1 time: 0.039729 Jun 16 17:50:34.346723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 424/851] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:50:34 2022] DELETE /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:34.353277 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:34.354836 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] [instance: 6228596e-39a4-457c-bdad-6fb60dc046f6] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:34.362266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:34.363462 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:34.364364 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:34.365167 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:34.387821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] HTTP exception thrown: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Request method failure captured: Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 HTTP/1.1 Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vgR8n1COjIKtBoDmaAKwtDUbsGHd2ekfio9Gck7tClkdpH7TQzLKJJYefcWxDdy-N7KCnTXNuAUp631tr55OYrYK89HYWxgv-7q_HqIl67U6bwIbTmDNpDuktlD2xPkyJZw3ZfeEJqU9qmyZ5w4MiICbjoDtV5-TvIC0XvjGyo6XI Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:50:34.389631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd279f49cbd84e9f926aa6372a4728d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd279f49cbd84e9f926aa6372a4728d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: dd279f49cbd84e9f926aa6372a4728d4 Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007647360 Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 813dd0cf7e1d4724b903b358aaac1ea7 Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeTestJSON-1007647360-project Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.391187 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '6228596e-39a4-457c-bdad-6fb60dc046f6'} Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:50:34.392065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. Jun 16 17:50:34.393563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:50:34.395524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] Returning 404 to user: Instance 6228596e-39a4-457c-bdad-6fb60dc046f6 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:50:34.395524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-af712992-6c07-4c9d-b132-d1ec07868601 tempest-AttachVolumeTestJSON-1007647360 tempest-AttachVolumeTestJSON-1007647360-project] 10.222.0.42 "GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6" status: 404 len: 111 microversion: 2.1 time: 0.041840 Jun 16 17:50:34.395524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 428/852] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:50:34 2022] GET /compute/v2.1/servers/6228596e-39a4-457c-bdad-6fb60dc046f6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:50:34.599044 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:34.599775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:34.605955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:34.606488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:34.607327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:34.607839 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:34.752655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:34.761669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:34.763204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:34.764444 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-76147487-0ecb-4dc0-af62-c3a2b0d671a2 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.169328 Jun 16 17:50:34.765202 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 425/853] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:34 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:35.783840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:35.784462 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:35.811882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:35.812366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:35.816483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:35.816483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:36.070316 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:36.079473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:36.082006 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:36.083707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-592b1d22-a8af-46a0-830a-d4c12b3ccc32 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.304532 Jun 16 17:50:36.094845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 429/854] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:35 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:37.101833 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:37.102362 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:37.109296 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:37.109634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:37.110639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:37.111167 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:37.468683 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:37.478379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:37.480316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:37.481519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5384aa70-9eef-4170-80f1-55fac35be8ab tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.383631 Jun 16 17:50:37.492256 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 426/855] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:37 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:50:38.498876 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:38.499504 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:38.507394 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:38.507848 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:38.508652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:38.509101 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:38.645306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:38.653552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:38.655051 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:38.656213 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a78ce71c-286c-442d-8c97-181103a65558 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.161265 Jun 16 17:50:38.656794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 430/856] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:38 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:39.677621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:39.678368 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:39.685512 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:39.686020 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:39.686824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:39.687260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:39.837741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:39.848188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:39.850045 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:39.851401 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0a9118e0-05c2-46bd-9fe1-6e7aeaa688f3 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.179526 Jun 16 17:50:39.852034 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 427/857] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:39 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:50:40.869923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:40.870682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:40.877692 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:40.878781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:40.879645 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:40.880095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:41.026591 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:41.036632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:41.038147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:41.039356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ef70de9a-81b7-486e-8af4-11761c872f36 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.173649 Jun 16 17:50:41.040106 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 431/858] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:40 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:41.124105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-1099d8bb-d6f7-4f81-8b91-75d0e3968714 req-d83d8529-23ea-4790-bd92-97f79075a9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "name": "network-vif-plugged", "status": "completed", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:41.135985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1099d8bb-d6f7-4f81-8b91-75d0e3968714 req-d83d8529-23ea-4790-bd92-97f79075a9bd service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:41.136724 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1099d8bb-d6f7-4f81-8b91-75d0e3968714 req-d83d8529-23ea-4790-bd92-97f79075a9bd service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:41.149597 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-1099d8bb-d6f7-4f81-8b91-75d0e3968714 req-d83d8529-23ea-4790-bd92-97f79075a9bd service nova] Creating event network-vif-plugged:90e9b67c-83ca-4a1b-b4d9-2731c84f1413 for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 on hv-cinder-83754 Jun 16 17:50:41.155231 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-1099d8bb-d6f7-4f81-8b91-75d0e3968714 req-d83d8529-23ea-4790-bd92-97f79075a9bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035879 Jun 16 17:50:41.155883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 428/859] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:42.058654 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:42.059274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:42.065927 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:42.066390 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:42.067174 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:42.067622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:42.199036 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:42.207813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:42.209340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:42.210506 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-893da187-f28d-4d02-a1a0-7f4014afc30c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.155742 Jun 16 17:50:42.211068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 432/860] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:42 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:43.231275 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:43.233164 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:43.241268 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:43.242465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:43.244112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:43.245000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:43.398571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:43.414775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:43.417107 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:43.419619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2b68e0ec-2162-452b-83eb-6ead54afad6a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.194676 Jun 16 17:50:43.420657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 429/861] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:43 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:44.437563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:44.438282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:44.446034 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:44.446605 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:44.447526 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:44.447923 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:44.595196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:44.604821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:44.606342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:44.607525 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-92017b9a-1182-4247-b4c7-a681ed67d088 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.173938 Jun 16 17:50:44.608224 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 433/862] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:44 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:45.629417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:45.630025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:45.636783 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:45.637170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:45.638221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:45.638662 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:45.775543 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:45.785174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:45.786707 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:45.787882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4057c6ee-bb05-4859-a63c-a2eb1325d635 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1731 microversion: 2.20 time: 0.162779 Jun 16 17:50:45.788646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 430/863] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:45 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:46.806021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:46.806635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:46.813074 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:46.813523 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:46.814284 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:46.814723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:46.945355 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:46.955758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:46.958605 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:50:46.959840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b296da7b-411d-446c-acec-099bc930ae41 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1718 microversion: 2.20 time: 0.157804 Jun 16 17:50:46.961783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 434/864] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:50:46 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:50:56.775411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:50:56.776025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:56.778269 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=19 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:56.778925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=68 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:56.784806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:56.785263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:56.786089 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:56.786502 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:56.808966 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1f69692b-c7f2-4363-bf76-f4a528a08cdd tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/ips" status: 200 len: 148 microversion: 2.1 time: 0.037464 Jun 16 17:50:56.809515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 431/865] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:50:56 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:50:58.124852 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a5fec2a-88b3-4091-a840-7bb39baa2766"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:50:58.125950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:50:58.128273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:58.129009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:58.135612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:58.136074 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:58.137196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:50:58.137592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:50:58.407122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cb9475bd-6b4a-49ff-b00b-0a294c80457b tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "POST /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286054 Jun 16 17:50:58.407907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 435/866] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:50:58 2022] POST /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:06.039003 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:06.040088 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:06.047098 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:06.047554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:06.048335 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:06.048805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:06.139904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lazy-loading 'services' on Instance uuid 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:51:06.225348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b717932a-b9af-4920-ab2f-b1db1554eaf6 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments/8a5fec2a-88b3-4091-a840-7bb39baa2766" status: 202 len: 0 microversion: 2.1 time: 0.190101 Jun 16 17:51:06.226860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 432/867] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:51:06 2022] DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments/8a5fec2a-88b3-4091-a840-7bb39baa2766 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:51:06.236854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:06.243699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:06.254647 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:06.255383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:06.256539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:06.257211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:06.318753 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7fa7d1cf-9025-4383-9cef-6e513a45d738 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087596 Jun 16 17:51:06.319602 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 436/868] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:51:06 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:07.331057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:07.332439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:07.339263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:07.339796 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:07.340681 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:07.341198 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:07.372602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7411da68-8d6e-4875-ac2b-62007202efaa tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046272 Jun 16 17:51:07.373160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 433/869] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jun 16 17:51:07 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:51:07.433025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:07.433533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:07.440495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:07.441018 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:07.442457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:07.442941 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:07.471266 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:51:07.553802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3e6ca87f-5782-40eb-bae1-9c4865140bf1 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 204 len: 0 microversion: 2.1 time: 0.123646 Jun 16 17:51:07.555057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 437/870] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:07 2022] DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:51:07.563786 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:07.564428 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:07.572486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:07.573340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:07.574145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:07.574591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:07.768993 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:07.777144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-022b7393-85a7-4510-b394-196e3d2b6ecf tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1679 microversion: 2.1 time: 0.217343 Jun 16 17:51:07.777703 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 434/871] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:07 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:08.796197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:08.797037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:08.805156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:08.805700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:08.806554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:08.807070 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:08.979422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:08.987815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-82ada36d-d5e0-4269-a941-a98c8a337d98 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1679 microversion: 2.1 time: 0.196411 Jun 16 17:51:08.989482 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 438/872] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:08 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:10.007971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:10.009447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:10.020660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:10.021110 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:10.022387 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:10.023091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:10.149316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fff53cb0d084d9284825488f6843ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf380fb2e904569b24c6212d88ac621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:10.157595 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c2175edc-9df8-4210-9f37-b44cf6560429 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 200 len: 1611 microversion: 2.1 time: 0.155094 Jun 16 17:51:10.158076 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 435/873] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:10 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 1611 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:10.434434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-1607aa07-3beb-4197-824e-a8e7c17712dd req-ffb8265b-6e00-4126-aa34-7cf6a86d835b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfb15f8-5d0c-459a-ab9e-b8c603f5d276", "name": "network-vif-deleted", "tag": "02b46b01-4ff5-4684-9280-acb28c448c4b"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:10.446935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1607aa07-3beb-4197-824e-a8e7c17712dd req-ffb8265b-6e00-4126-aa34-7cf6a86d835b service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:10.447590 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1607aa07-3beb-4197-824e-a8e7c17712dd req-ffb8265b-6e00-4126-aa34-7cf6a86d835b service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:10.465954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-1607aa07-3beb-4197-824e-a8e7c17712dd req-ffb8265b-6e00-4126-aa34-7cf6a86d835b service nova] Creating event network-vif-deleted:02b46b01-4ff5-4684-9280-acb28c448c4b for instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 on hv-cinder-83754 Jun 16 17:51:10.471948 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-1607aa07-3beb-4197-824e-a8e7c17712dd req-ffb8265b-6e00-4126-aa34-7cf6a86d835b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041133 Jun 16 17:51:10.473603 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 439/874] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:11.177360 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:11.177985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:11.184617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:11.185105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:11.185974 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:11.186483 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:11.200813 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 HTTP/1.1 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:51:11.202655 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:11.204490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '6bfb15f8-5d0c-459a-ab9e-b8c603f5d276'} Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:11.205451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:11.207077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:11.208479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:11.209017 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c699b1c3-76b0-4cae-bffa-ce24f0e25987 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 404 len: 111 microversion: 2.1 time: 0.037342 Jun 16 17:51:11.210855 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 436/875] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:11 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:11.219557 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f238769d-8f56-4165-a814-8314638c712f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '.version_select at 0x7f288c097040>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:11.239781 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f238769d-8f56-4165-a814-8314638c712f tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609944648" status: 202 len: 0 microversion: 2.1 time: 0.024525 Jun 16 17:51:11.240504 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 440/876] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jun 16 17:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609944648 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:51:13.271942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:13.272517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:13.279274 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:13.279806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:13.280694 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:13.281138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:13.295545 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 HTTP/1.1 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:51:13.297170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.298751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '6bfb15f8-5d0c-459a-ab9e-b8c603f5d276'} Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:13.303415 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.304885 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.306361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:13.306361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7262a31c-e35f-41e5-bea7-547bea773c22 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 404 len: 111 microversion: 2.1 time: 0.031321 Jun 16 17:51:13.306361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 437/877] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:13 2022] DELETE /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:13.307800 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:13.308583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:13.315119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:13.315573 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:13.316400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:13.317364 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:13.331568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 HTTP/1.1 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:13.333908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.336937 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '6bfb15f8-5d0c-459a-ab9e-b8c603f5d276'} Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:13.338944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. Jun 16 17:51:13.340485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:13.341804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance 6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:13.341804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-070b58ee-9e6f-4716-9e41-5827995cb825 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276" status: 404 len: 111 microversion: 2.1 time: 0.031435 Jun 16 17:51:13.341804 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 441/878] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:13 2022] GET /compute/v2.1/servers/6bfb15f8-5d0c-459a-ab9e-b8c603f5d276 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:13.782749 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1996761878", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "networks": [{"uuid": "23cca9b9-31dc-45f8-b4b9-f0d16fd7706a"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:13.847226 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] validate_networks() for [('23cca9b9-31dc-45f8-b4b9-f0d16fd7706a', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:51:14.279013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:51:14.279609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:51:14.280068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:51:14.280609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:51:14.281137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:51:14.290389 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.290891 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.291671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.292107 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.309728 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Getting quotas for project c6a903cccbd4459288d72e52410ffca1. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:51:14.313641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Getting quotas for user c4bffefe8fb2475a96ea033d07c790f2 and project c6a903cccbd4459288d72e52410ffca1. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:51:14.327008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:51:14.329681 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:51:14.374179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-65060743-f885-404d-908c-3d09a86b5932 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596293 Jun 16 17:51:14.374838 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 438/879] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:51:14.385616 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-65f8c089-e550-4394-8c21-bad668457f5b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:14.386243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-65f8c089-e550-4394-8c21-bad668457f5b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:14.444726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-65f8c089-e550-4394-8c21-bad668457f5b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:14.454636 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-65f8c089-e550-4394-8c21-bad668457f5b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1214 microversion: 2.1 time: 0.072881 Jun 16 17:51:14.455618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 442/880] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:14 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:14.486407 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:14.486912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:14.494606 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.495068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.495830 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.496270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.510242 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 HTTP/1.1 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:51:14.512063 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.513523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'eab2d5df-1539-4e63-a3ee-269f6116bbb8'} Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:14.514300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.515647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.516882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:14.516882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-98151999-4ea6-4c93-b836-c191e9e89583 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 404 len: 111 microversion: 2.1 time: 0.031059 Jun 16 17:51:14.516882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 439/881] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:14 2022] DELETE /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:14.522197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:14.522806 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: eab2d5df-1539-4e63-a3ee-269f6116bbb8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:14.528951 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.529407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.530219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.530679 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.544457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 HTTP/1.1 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:14.546022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.547742 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'eab2d5df-1539-4e63-a3ee-269f6116bbb8'} Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:14.548668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. Jun 16 17:51:14.550157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.552939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance eab2d5df-1539-4e63-a3ee-269f6116bbb8 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:14.552939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a53b4e06-c221-44b8-a17e-438e0c9bead9 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8" status: 404 len: 111 microversion: 2.1 time: 0.029158 Jun 16 17:51:14.552939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 443/882] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:14 2022] GET /compute/v2.1/servers/eab2d5df-1539-4e63-a3ee-269f6116bbb8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:14.556572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:14.557071 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:14.563001 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.563452 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.564217 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.564692 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.578553 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 HTTP/1.1 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:51:14.580138 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.582036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '3bcde2b0-d028-4892-bcfe-edcd9604daf8'} Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:14.582962 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.584228 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.586591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:14.586591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-66668d95-78ca-49d2-b78e-e19ff78af168 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 404 len: 111 microversion: 2.1 time: 0.028928 Jun 16 17:51:14.586591 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 440/883] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:14 2022] DELETE /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:14.590362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:14.590985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: 3bcde2b0-d028-4892-bcfe-edcd9604daf8] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:14.597046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.597614 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.598551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:14.598894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:14.612521 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 HTTP/1.1 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:14.614864 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.616362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '3bcde2b0-d028-4892-bcfe-edcd9604daf8'} Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:14.617118 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. Jun 16 17:51:14.618296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:14.619365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance 3bcde2b0-d028-4892-bcfe-edcd9604daf8 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:14.619365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f28e1139-c95b-4be0-b0c6-c2be4c5506b2 tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8" status: 404 len: 111 microversion: 2.1 time: 0.029706 Jun 16 17:51:14.619896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 444/884] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:14 2022] GET /compute/v2.1/servers/3bcde2b0-d028-4892-bcfe-edcd9604daf8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:51:15.418290 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-941500066", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "networks": [{"uuid": "c548a7ca-f4a7-4021-974b-b75ad485bd67"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:15.474106 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:15.475269 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:15.482545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:15.483226 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:15.484225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:15.484340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] validate_networks() for [('c548a7ca-f4a7-4021-974b-b75ad485bd67', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:51:15.484984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:15.581569 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:15.590194 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dba6fadf-c231-47d1-9f20-684b1e9b1985 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1284 microversion: 2.1 time: 0.121854 Jun 16 17:51:15.590767 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 445/885] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:15 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:15.757857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:15.758381 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:15.764463 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:15.764914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:15.765774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:15.766207 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:15.779977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff HTTP/1.1 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:15.781648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.783297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'dc1a3f32-7aab-4b92-81cf-74a18b529bff'} Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:15.784202 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.785736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.787180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:15.787180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-174d71d2-a0f3-4799-999c-3c94f5d8f9ec tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 404 len: 111 microversion: 2.1 time: 0.029630 Jun 16 17:51:15.787180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 446/886] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:15 2022] DELETE /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:51:15.791817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:15.792431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] [instance: dc1a3f32-7aab-4b92-81cf-74a18b529bff] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:15.798428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:15.798865 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:15.799630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:15.800066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:15.814563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] HTTP exception thrown: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Request method failure captured: Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff HTTP/1.1 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vl06LYVPf53jOnahROOchuNzIqLVlQQw3nSvNauTg7Wu2KLgldY2Sn2skb9BH2Peco2slcEeS6hOdBKsPql9e1pjl-bFySI6tlyiimjCKYQfOvwVSd2IE_3eChAHPx9Nb8X2dVo9p0GK0M7NIgf7lndzKD5dNFzpmI7UadiJontv4 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:15.816161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4cf380fb2e904569b24c6212d88ac621", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4cf380fb2e904569b24c6212d88ac621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 4cf380fb2e904569b24c6212d88ac621 Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1527751187 Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 8fff53cb0d084d9284825488f6843ee4 Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeNegativeTest-1527751187-project Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.818799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'dc1a3f32-7aab-4b92-81cf-74a18b529bff'} Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:15.820045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. Jun 16 17:51:15.822076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:15.823872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] Returning 404 to user: Instance dc1a3f32-7aab-4b92-81cf-74a18b529bff could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:15.823872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0f11154c-38ac-439c-8418-0fc11d30e04d tempest-AttachVolumeNegativeTest-1527751187 tempest-AttachVolumeNegativeTest-1527751187-project] 10.222.0.42 "GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff" status: 404 len: 111 microversion: 2.1 time: 0.030052 Jun 16 17:51:15.824857 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 447/887] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:15 2022] GET /compute/v2.1/servers/dc1a3f32-7aab-4b92-81cf-74a18b529bff => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:16.074530 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:51:16.075275 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:51:16.077325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:51:16.078026 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:51:16.079502 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:51:16.093677 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:16.094482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:16.096300 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:16.097066 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:16.118618 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Getting quotas for project 55704b6435104c8e958ae6c5bb202f24. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:51:16.123354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Getting quotas for user 0824d8df380e477b85690814b0a2a9e3 and project 55704b6435104c8e958ae6c5bb202f24. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:51:16.136756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:51:16.139354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:51:16.204600 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3a6e3579-50a5-419b-bd62-d73496213e9f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790052 Jun 16 17:51:16.205922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 441/888] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:51:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:51:16.217921 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-284fe6d4-d9d6-42cb-be1e-8d22d7947db7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:16.218862 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-284fe6d4-d9d6-42cb-be1e-8d22d7947db7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:16.323396 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-284fe6d4-d9d6-42cb-be1e-8d22d7947db7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:16.335549 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-284fe6d4-d9d6-42cb-be1e-8d22d7947db7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1218 microversion: 2.1 time: 0.121987 Jun 16 17:51:16.336756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 448/889] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:16 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:16.608555 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:16.609903 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:16.619546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:16.620852 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:16.621662 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:16.622105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:16.950307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:16.962795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-da6ed7e2-7c22-4113-8a92-7f3f13683bf0 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.358342 Jun 16 17:51:16.978956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 442/890] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:16 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:17.353641 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:17.354445 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:17.370968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-66255b21-1cf1-48d1-ad47-ba85b3c88053 req-5b7f17ce-39e6-4462-9f58-a62a656dec57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490551e2-1558-44c9-b3f8-220b4f1353e7", "tag": "4a212844-98ad-40b7-815f-57f077860fe4"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:17.381451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:17.382208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:17.385423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:17.387231 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:17.391581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-66255b21-1cf1-48d1-ad47-ba85b3c88053 req-5b7f17ce-39e6-4462-9f58-a62a656dec57 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:17.396852 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-66255b21-1cf1-48d1-ad47-ba85b3c88053 req-5b7f17ce-39e6-4462-9f58-a62a656dec57 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:17.431982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-66255b21-1cf1-48d1-ad47-ba85b3c88053 req-5b7f17ce-39e6-4462-9f58-a62a656dec57 service nova] Creating event network-changed:4a212844-98ad-40b7-815f-57f077860fe4 for instance 490551e2-1558-44c9-b3f8-220b4f1353e7 on hv-cinder-83754 Jun 16 17:51:17.439370 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-66255b21-1cf1-48d1-ad47-ba85b3c88053 req-5b7f17ce-39e6-4462-9f58-a62a656dec57 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072654 Jun 16 17:51:17.441004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 443/891] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:17.491600 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:17.502942 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-08d588b1-6fdc-4614-bacb-cb01e3d9014d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1270 microversion: 2.1 time: 0.153306 Jun 16 17:51:17.503541 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 449/892] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:17 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:17.987649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:17.990016 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:17.999998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:18.002700 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:18.006810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:18.008576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:18.521793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:18.522572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:18.529483 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:18.530166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:18.531132 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:18.532515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:18.664051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:18.671862 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e137ebe9-9b00-43bc-8728-73720fda29c9 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.689494 Jun 16 17:51:18.685295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 444/893] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:17 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:18.717304 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:18.726867 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3b7da47b-19db-4a29-8366-65bfef5387b9 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1276 microversion: 2.1 time: 0.209294 Jun 16 17:51:18.727687 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 450/894] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:18 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:19.691821 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:19.693363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:19.700145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:19.700623 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:19.701422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:19.701874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:19.743613 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:19.744143 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:19.750689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:19.751138 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:19.751901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:19.752337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.247236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:20.264234 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ce58a2e8-57ef-4db1-a60c-375904d56f0a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.576823 Jun 16 17:51:20.267363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 445/895] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:19 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:20.281707 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:20.282794 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:20.292062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.292959 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.294225 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.295510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.304057 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:20.314126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d9c2d67a-a1dd-44f9-b80c-1737f1159182 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.574147 Jun 16 17:51:20.317428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 451/896] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:19 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:20.349581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-dee53396-adae-4c05-a31e-6124b1d2c661 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080546 Jun 16 17:51:20.349847 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 446/897] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jun 16 17:51:20 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:20.424245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:20.424854 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:20.432237 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.433108 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.433690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.434015 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.463670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:51:20.557688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-00f31bcc-73c7-4b65-b9a1-2aee3f2cd769 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 204 len: 0 microversion: 2.20 time: 0.132168 Jun 16 17:51:20.559333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 452/898] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jun 16 17:51:20 2022] DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:51:20.567845 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:20.568934 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:20.588285 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.591247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.592260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.593425 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.806982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:20.818846 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:20.820639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:20.821932 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6a6eb79a-865c-4803-b18c-93eb07187f77 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.258255 Jun 16 17:51:20.822745 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 447/899] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:20 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:51:20.876493 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-f6a110dd-fdd9-4a58-b65f-0d59c93aa422 req-2ba7f070-d197-49da-a554-41eb4f70cd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f", "tag": "7f7361c5-43ed-41b5-98cd-1d49941f3a74"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:20.888158 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-f6a110dd-fdd9-4a58-b65f-0d59c93aa422 req-2ba7f070-d197-49da-a554-41eb4f70cd50 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:20.888334 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-f6a110dd-fdd9-4a58-b65f-0d59c93aa422 req-2ba7f070-d197-49da-a554-41eb4f70cd50 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:20.900282 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-f6a110dd-fdd9-4a58-b65f-0d59c93aa422 req-2ba7f070-d197-49da-a554-41eb4f70cd50 service nova] Creating event network-changed:7f7361c5-43ed-41b5-98cd-1d49941f3a74 for instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f on hv-cinder-83754 Jun 16 17:51:20.905048 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-f6a110dd-fdd9-4a58-b65f-0d59c93aa422 req-2ba7f070-d197-49da-a554-41eb4f70cd50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034756 Jun 16 17:51:20.905635 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 453/900] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:21.283033 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:21.283650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:21.290653 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:21.291120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:21.291969 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:21.292471 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:21.333809 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:21.334815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:21.344437 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:21.345605 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:21.347009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:21.348214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:21.370253 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:21.499951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:21.507571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-723054c3-135f-436a-ad9e-4f974b7714aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.228378 Jun 16 17:51:21.508136 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 448/901] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:21 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:21.521427 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:21.529133 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9f83b1d6-55b4-461b-ae9f-34db9e0f460a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.200056 Jun 16 17:51:21.529777 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 454/902] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:21 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:21.632934 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ea6d9da2-1757-4bba-9e05-4d8e960f97a3 tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Action: 'create', calling method: .version_select at 0x7f288c0fddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-206509981", "metadata": {"Type": "work"}}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:21.841094 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:21.841736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:21.847636 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:21.848050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:21.848855 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:21.849356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:21.946000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ea6d9da2-1757-4bba-9e05-4d8e960f97a3 tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.431116 Jun 16 17:51:21.946685 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 449/903] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jun 16 17:51:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 438 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 17:51:21.957550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3cacc125-d7fe-430a-9aa4-bfcbbf4b1ced tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Calling method '.version_select at 0x7f288c074820>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:22.026925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3cacc125-d7fe-430a-9aa4-bfcbbf4b1ced tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109" status: 200 len: 352 microversion: 2.1 time: 0.072931 Jun 16 17:51:22.031859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 450/904] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:21 2022] GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:22.073936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:22.081936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:22.083443 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:22.084617 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b0a902be-f872-4cf9-8a35-5c2d78ac8596 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.247435 Jun 16 17:51:22.085179 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 455/905] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:21 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:51:22.525236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:22.525854 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:22.532818 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:22.533272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:22.534046 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:22.534495 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:22.546514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:22.547408 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:22.554579 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:22.555044 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:22.555824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:22.556265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:23.229960 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:23.239248 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bb5b4b00-b9c1-4b2a-91ce-b91f73cc8288 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.716869 Jun 16 17:51:23.239837 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 451/906] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:22 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:23.244558 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-65d63748-fb44-45a0-846a-c6a286a648b2 tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Calling method '.version_select at 0x7f288c074790>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:23.251433 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:23.270726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3ebe8759-7530-4233-b0e8-5a18cd8f3423 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.727983 Jun 16 17:51:23.276693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 456/907] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:22 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:23.290944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:23.291668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:23.300725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:23.301456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:23.302265 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:23.302678 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:23.336467 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-65d63748-fb44-45a0-846a-c6a286a648b2 tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109" status: 200 len: 353 microversion: 2.1 time: 0.095278 Jun 16 17:51:23.337447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 452/908] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:23 2022] GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:23.345763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-9fd26546-cc77-4662-b25d-e6e399b1bba0 req-4bebd7ce-6c7c-44e3-8862-0b5d02dd41be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490551e2-1558-44c9-b3f8-220b4f1353e7", "name": "network-vif-plugged", "status": "completed", "tag": "4a212844-98ad-40b7-815f-57f077860fe4"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:23.357874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-9fd26546-cc77-4662-b25d-e6e399b1bba0 req-4bebd7ce-6c7c-44e3-8862-0b5d02dd41be service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:23.358327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-9fd26546-cc77-4662-b25d-e6e399b1bba0 req-4bebd7ce-6c7c-44e3-8862-0b5d02dd41be service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:23.370566 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-9fd26546-cc77-4662-b25d-e6e399b1bba0 req-4bebd7ce-6c7c-44e3-8862-0b5d02dd41be service nova] Creating event network-vif-plugged:4a212844-98ad-40b7-815f-57f077860fe4 for instance 490551e2-1558-44c9-b3f8-220b4f1353e7 on hv-cinder-83754 Jun 16 17:51:23.375916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-9fd26546-cc77-4662-b25d-e6e399b1bba0 req-4bebd7ce-6c7c-44e3-8862-0b5d02dd41be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 Jun 16 17:51:23.377263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 453/909] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:23.383859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-45d21b91-d8b7-48f1-965c-437f612f575d tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Calling method '.version_select at 0x7f288c0379d0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:23.434831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-45d21b91-d8b7-48f1-965c-437f612f575d tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109" status: 200 len: 353 microversion: 2.1 time: 0.056028 Jun 16 17:51:23.435398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 454/910] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:23 2022] GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:23.454100 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9031c015-e874-4cc6-9e7f-53072d11e6bb tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Calling method '.version_select at 0x7f288c0fdd30>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:23.532814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9031c015-e874-4cc6-9e7f-53072d11e6bb tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109" status: 202 len: 0 microversion: 2.1 time: 0.083009 Jun 16 17:51:23.535303 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 455/911] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:51:23 2022] DELETE /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:51:23.543626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-744cce01-d828-46f9-bfd8-fffa13d1e82e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Calling method '.version_select at 0x7f288c098310>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:23.596174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-744cce01-d828-46f9-bfd8-fffa13d1e82e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109" status: 200 len: 352 microversion: 2.1 time: 0.056616 Jun 16 17:51:23.596843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 456/912] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:23 2022] GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:23.687844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:23.697009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:23.698994 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:23.700280 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c938e050-7e6d-4be1-8494-7a6094c5fd9a tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1724 microversion: 2.20 time: 0.422330 Jun 16 17:51:23.700881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 457/913] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:23 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:51:24.123087 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-e338cdf0-6619-4084-8147-a7d959609384 req-c9adf8d1-3b38-4672-8359-74d7fb3175b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c1089a-2ab6-49c7-b121-93d0c558bd11", "name": "network-vif-deleted", "tag": "90e9b67c-83ca-4a1b-b4d9-2731c84f1413"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:24.132742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e338cdf0-6619-4084-8147-a7d959609384 req-c9adf8d1-3b38-4672-8359-74d7fb3175b2 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.133187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e338cdf0-6619-4084-8147-a7d959609384 req-c9adf8d1-3b38-4672-8359-74d7fb3175b2 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.145309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-e338cdf0-6619-4084-8147-a7d959609384 req-c9adf8d1-3b38-4672-8359-74d7fb3175b2 service nova] Creating event network-vif-deleted:90e9b67c-83ca-4a1b-b4d9-2731c84f1413 for instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 on hv-cinder-83754 Jun 16 17:51:24.150383 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-e338cdf0-6619-4084-8147-a7d959609384 req-c9adf8d1-3b38-4672-8359-74d7fb3175b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 Jun 16 17:51:24.150989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 457/914] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:24.257942 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:24.258666 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:24.266510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.267311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.268296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.268843 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.294399 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:24.295739 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:24.306634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.307090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.308068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.308714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.469765 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:24.478533 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dfca570b-e8fe-49a2-8710-9d9f2d7fdd40 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.225252 Jun 16 17:51:24.479257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 458/915] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:24 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:24.498011 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:24.506091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-472f5563-7f98-43d8-900f-fa4918242d68 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.217071 Jun 16 17:51:24.506986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 458/916] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:24 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:24.609989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bd35a729-d193-4402-9fec-70f78815800e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Calling method '.version_select at 0x7f288c193700>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:24.639592 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-bd35a729-d193-4402-9fec-70f78815800e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] HTTP exception thrown: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bd35a729-d193-4402-9fec-70f78815800e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Request method failure captured: Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 HTTP/1.1 Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22Ze629UGyvyiNbi04-E_zwXMV6t4ecLRIUP1XIZCQ4JAIHnTnC_RzvRxitYzaXCOkIdslV030D_z7wzqUlLSXiHV6I9qxISyznMyPyuFPHBtpR5UM_agdcUSfAM7x7nmj8Mi5zEXKQYXrATcDljRjtqagenFxkVMyMLNFsaVHaAyA Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 151a95de1f164fb290d59ed9fdf70d14 Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesGetTestJSON-1800178518 Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:24.641726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/151a95de1f164fb290d59ed9fdf70d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/151a95de1f164fb290d59ed9fdf70d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_151a95de1f164fb290d59ed9fdf70d14", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/151a95de1f164fb290d59ed9fdf70d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesGetTestJSON-1800178518 Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 151a95de1f164fb290d59ed9fdf70d14 Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesGetTestJSON-1800178518 Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesGetTestJSON-1800178518-project Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: ea0166b3c740455784ec673c20adbd7f Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesGetTestJSON-1800178518-project Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109'} Jun 16 17:51:24.643352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. (HTTP 404) (Request-ID: req-6f8969f2-b37d-486f-af5d-c7560967fb71) Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:24.644586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:24.645989 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:51:24.647423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bd35a729-d193-4402-9fec-70f78815800e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] Returning 404 to user: Volume a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bd35a729-d193-4402-9fec-70f78815800e tempest-VolumesGetTestJSON-1800178518 tempest-VolumesGetTestJSON-1800178518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109" status: 404 len: 109 microversion: 2.1 time: 0.037108 Jun 16 17:51:24.648886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 459/917] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:24 2022] GET /compute/v2.1/os-volumes/a61c55fc-2fd2-45cb-b7b5-31ef6a6ad109 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:24.719409 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:24.719928 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:24.727290 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.727752 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.728642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:24.729013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:24.733350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:24.804232 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:24.813442 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:24.815111 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:24.816619 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4b3fb915-a336-4875-8703-11a2157350de tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1657 microversion: 2.20 time: 0.101063 Jun 16 17:51:24.824499 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 459/918] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:24 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1657 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:51:25.496408 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:25.497032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:25.504571 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.504931 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.505648 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.506100 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.524748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:25.525363 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:25.533575 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.534324 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.535340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.535955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.716685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:25.719980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:25.724850 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8e4f7671-5327-46fb-b7ae-6b96cb3449aa tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1314 microversion: 2.1 time: 0.232833 Jun 16 17:51:25.725623 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 460/919] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:25 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:25.728400 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-24ef8721-d085-4388-9899-1846d977aae7 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.207926 Jun 16 17:51:25.728978 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 460/920] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:25 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:25.835548 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:25.836165 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:25.842300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.842764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.843542 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.843987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.880586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:25.881060 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:25.881519 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lazy-loading 'fault' on Instance uuid 78c1089a-2ab6-49c7-b121-93d0c558bd11 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:51:25.936049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:25.944998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:25.946496 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b078c6bfca04de790e7b2e45739033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6671e3a8bd4821b17ef2d2a426ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:25.947734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8e361f9c-cdea-4904-a88b-c49d97b78eb5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 200 len: 1371 microversion: 2.20 time: 0.116858 Jun 16 17:51:25.948647 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 461/921] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:25 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:51:26.742806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:26.743602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:26.745483 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=4 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:26.745707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:26.746223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:26.746649 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=12 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:26.750444 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=4 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:26.756422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:26.756814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:26.757620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:26.758058 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:26.758663 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:26.759220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:26.760133 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:26.760682 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:26.978215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:26.986183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:26.994485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e8f2f360-f2ac-4b7e-88ba-80fd5de4ec6c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.252795 Jun 16 17:51:26.995074 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 462/922] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:26 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:26.996559 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3b550524-4464-4034-a841-90b0a11a9528 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1498 microversion: 2.1 time: 0.258746 Jun 16 17:51:27.008278 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 461/923] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:26 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:27.008470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:27.008995 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:27.015485 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:27.015942 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:27.016762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:27.017199 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:27.031397 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] HTTP exception thrown: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Request method failure captured: Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 HTTP/1.1 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpdg63gqjmAZ4jJTBFAE_nUMU6MT0Bzb1jL1tgVxu4cvNQ4DwY7VFNT8wte3-3pm2RgfRM64ZMj1QFSbo65nZ8_V3xFfU5SndCCD9tXe9R4sxqdA9sKvHn5wwhwANT4dgsQ5iuCz0h5SIml0LGVyj5VPr7LS_gKtyYfkd7AO2Z83s Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:27.032978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc6671e3a8bd4821b17ef2d2a426ee58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 7b078c6bfca04de790e7b2e45739033e Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:27.034451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '78c1089a-2ab6-49c7-b121-93d0c558bd11'} Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:27.036297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:27.037794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:27.040723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Returning 404 to user: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:27.040723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-722bedba-dd3f-42dd-b8b7-7b5e8696dd87 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 404 len: 111 microversion: 2.20 time: 0.029899 Jun 16 17:51:27.040723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 463/924] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:26 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:51:27.044193 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a9b3140e-62fc-472e-b25a-40cc689d99c9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '.version_select at 0x7f287ffae790>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:27.054861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:27.076694 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a9b3140e-62fc-472e-b25a-40cc689d99c9 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479319083" status: 204 len: 0 microversion: 2.20 time: 0.031760 Jun 16 17:51:27.076694 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 462/925] 10.222.0.42 () {60 vars in 1258 bytes} [Thu Jun 16 17:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479319083 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 17:51:27.559429 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:27.559936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:27.566000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:27.566460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:27.567241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:27.567686 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:27.594081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:51:27.690431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-64e17334-8b21-450d-bb50-456f52d4a2d5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "DELETE /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 204 len: 0 microversion: 2.1 time: 0.134526 Jun 16 17:51:27.693768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 464/926] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:27 2022] DELETE /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:51:27.702639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:27.703464 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:27.711274 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:27.712500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:27.713351 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:27.714024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:27.942519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:27.950802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-27417059-00f5-41b3-84c5-b612edd044f2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1504 microversion: 2.1 time: 0.252536 Jun 16 17:51:27.951574 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 463/927] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:27 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:28.012087 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:28.012907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:28.020204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:28.020814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:28.021845 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:28.022446 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:28.171516 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:28.179728 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d05d5364-e63b-4300-918f-48f92128289f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.172424 Jun 16 17:51:28.180298 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 465/928] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:28 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:28.968327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:28.968968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:28.975643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:28.976103 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:28.976909 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:28.977482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.044563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:29.045776 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:29.050536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:29.055080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.055613 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.056521 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.057173 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.077234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] HTTP exception thrown: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Request method failure captured: Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 HTTP/1.1 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpdg63gqjmAZ4jJTBFAE_nUMU6MT0Bzb1jL1tgVxu4cvNQ4DwY7VFNT8wte3-3pm2RgfRM64ZMj1QFSbo65nZ8_V3xFfU5SndCCD9tXe9R4sxqdA9sKvHn5wwhwANT4dgsQ5iuCz0h5SIml0LGVyj5VPr7LS_gKtyYfkd7AO2Z83s Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:29.079028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc6671e3a8bd4821b17ef2d2a426ee58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 7b078c6bfca04de790e7b2e45739033e Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.080859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '78c1089a-2ab6-49c7-b121-93d0c558bd11'} Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:29.082513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.085166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.087595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Returning 404 to user: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:29.087595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4817cf36-3bab-4981-ac38-c01bb2a8220c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 404 len: 111 microversion: 2.20 time: 0.041339 Jun 16 17:51:29.087595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 466/929] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jun 16 17:51:29 2022] DELETE /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 17:51:29.089794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:29.090396 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: 78c1089a-2ab6-49c7-b121-93d0c558bd11] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:29.096577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.097065 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.098300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.098747 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.112730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] HTTP exception thrown: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Request method failure captured: Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 HTTP/1.1 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpdg63gqjmAZ4jJTBFAE_nUMU6MT0Bzb1jL1tgVxu4cvNQ4DwY7VFNT8wte3-3pm2RgfRM64ZMj1QFSbo65nZ8_V3xFfU5SndCCD9tXe9R4sxqdA9sKvHn5wwhwANT4dgsQ5iuCz0h5SIml0LGVyj5VPr7LS_gKtyYfkd7AO2Z83s Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:29.114227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc6671e3a8bd4821b17ef2d2a426ee58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 7b078c6bfca04de790e7b2e45739033e Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.115916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '78c1089a-2ab6-49c7-b121-93d0c558bd11'} Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:29.117803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. Jun 16 17:51:29.119356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:29.120768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Returning 404 to user: Instance 78c1089a-2ab6-49c7-b121-93d0c558bd11 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:29.120768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-eb4e931b-0709-4c04-8c58-6f7ed4979cfc tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11" status: 404 len: 111 microversion: 2.20 time: 0.029463 Jun 16 17:51:29.120768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 467/930] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:29 2022] GET /compute/v2.1/servers/78c1089a-2ab6-49c7-b121-93d0c558bd11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:51:29.172890 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:29.184355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c4f14e9f-6f9f-4657-987d-0b5c766f7cf4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1504 microversion: 2.1 time: 0.219683 Jun 16 17:51:29.188417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 464/931] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:28 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:29.196085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:29.197008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:29.208520 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.208938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.209909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.211097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.364270 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-59b69b0c-ca14-45ba-8a8b-7aa9e6aeb6fa req-1c679cff-ae65-4035-83c4-f077b6dad3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f", "name": "network-vif-plugged", "status": "completed", "tag": "7f7361c5-43ed-41b5-98cd-1d49941f3a74"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:29.384725 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-59b69b0c-ca14-45ba-8a8b-7aa9e6aeb6fa req-1c679cff-ae65-4035-83c4-f077b6dad3f6 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.386160 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-59b69b0c-ca14-45ba-8a8b-7aa9e6aeb6fa req-1c679cff-ae65-4035-83c4-f077b6dad3f6 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.404985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-59b69b0c-ca14-45ba-8a8b-7aa9e6aeb6fa req-1c679cff-ae65-4035-83c4-f077b6dad3f6 service nova] Creating event network-vif-plugged:7f7361c5-43ed-41b5-98cd-1d49941f3a74 for instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f on hv-cinder-83754 Jun 16 17:51:29.417909 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:29.422025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-59b69b0c-ca14-45ba-8a8b-7aa9e6aeb6fa req-1c679cff-ae65-4035-83c4-f077b6dad3f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062020 Jun 16 17:51:29.422647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 465/932] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:29.432512 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-97d01f3d-079f-4ff3-a386-66f5f10bdadd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.240291 Jun 16 17:51:29.442764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 468/933] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:29 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:29.936077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-29f6e5a0-1c82-449b-8b99-70f495e89b0f req-3e408dfe-40c9-4746-8043-9b739e3dac8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490551e2-1558-44c9-b3f8-220b4f1353e7", "name": "network-vif-deleted", "tag": "4a212844-98ad-40b7-815f-57f077860fe4"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:29.944696 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-29f6e5a0-1c82-449b-8b99-70f495e89b0f req-3e408dfe-40c9-4746-8043-9b739e3dac8e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:29.945140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-29f6e5a0-1c82-449b-8b99-70f495e89b0f req-3e408dfe-40c9-4746-8043-9b739e3dac8e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:29.955650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-29f6e5a0-1c82-449b-8b99-70f495e89b0f req-3e408dfe-40c9-4746-8043-9b739e3dac8e service nova] Creating event network-vif-deleted:4a212844-98ad-40b7-815f-57f077860fe4 for instance 490551e2-1558-44c9-b3f8-220b4f1353e7 on hv-cinder-83754 Jun 16 17:51:29.962113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-29f6e5a0-1c82-449b-8b99-70f495e89b0f req-3e408dfe-40c9-4746-8043-9b739e3dac8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029521 Jun 16 17:51:29.962812 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 466/934] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:30.201997 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:30.202841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:30.211169 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.211633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.212598 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.213016 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.245055 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.245510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.246077 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lazy-loading 'fault' on Instance uuid 490551e2-1558-44c9-b3f8-220b4f1353e7 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:51:30.295510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:30.303445 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bf834cb3-084a-4863-9d4e-6f2689ff3bb4 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1304 microversion: 2.1 time: 0.105193 Jun 16 17:51:30.304230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 469/935] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:30 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:30.304651 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:30.305523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:30.312823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.313367 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.314158 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.314608 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.329391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] HTTP exception thrown: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Request method failure captured: Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea HTTP/1.1 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq2vpdg63gqjmAZ4jJTBFAE_nUMU6MT0Bzb1jL1tgVxu4cvNQ4DwY7VFNT8wte3-3pm2RgfRM64ZMj1QFSbo65nZ8_V3xFfU5SndCCD9tXe9R4sxqdA9sKvHn5wwhwANT4dgsQ5iuCz0h5SIml0LGVyj5VPr7LS_gKtyYfkd7AO2Z83s Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:51:30.331144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc6671e3a8bd4821b17ef2d2a426ee58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 7b078c6bfca04de790e7b2e45739033e Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.333807 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': 'dd9a2013-38fe-499c-a84e-97e2ca6e48ea'} Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:30.334889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.336331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.337986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Returning 404 to user: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:30.337986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cd0c6f59-0b8b-4dcd-814f-1074da867df5 tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 404 len: 111 microversion: 2.20 time: 0.035998 Jun 16 17:51:30.337986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 467/936] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jun 16 17:51:30 2022] DELETE /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:51:30.343816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:30.344452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] [instance: dd9a2013-38fe-499c-a84e-97e2ca6e48ea] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:30.351076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.351524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.352292 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.352780 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.367494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] HTTP exception thrown: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Request method failure captured: Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea HTTP/1.1 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq2vpdg63gqjmAZ4jJTBFAE_nUMU6MT0Bzb1jL1tgVxu4cvNQ4DwY7VFNT8wte3-3pm2RgfRM64ZMj1QFSbo65nZ8_V3xFfU5SndCCD9tXe9R4sxqdA9sKvHn5wwhwANT4dgsQ5iuCz0h5SIml0LGVyj5VPr7LS_gKtyYfkd7AO2Z83s Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:30.369289 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc6671e3a8bd4821b17ef2d2a426ee58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc6671e3a8bd4821b17ef2d2a426ee58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: bc6671e3a8bd4821b17ef2d2a426ee58 Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835825488 Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 7b078c6bfca04de790e7b2e45739033e Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835825488-project Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.370964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'dd9a2013-38fe-499c-a84e-97e2ca6e48ea'} Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:30.371796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. Jun 16 17:51:30.373273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:30.374661 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] Returning 404 to user: Instance dd9a2013-38fe-499c-a84e-97e2ca6e48ea could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:30.374661 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-138c94cb-f1bc-47e7-8867-0423f69ddf0c tempest-AttachVolumeShelveTestJSON-835825488 tempest-AttachVolumeShelveTestJSON-835825488-project] 10.222.0.42 "GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea" status: 404 len: 111 microversion: 2.20 time: 0.031708 Jun 16 17:51:30.374661 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 470/937] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jun 16 17:51:30 2022] GET /compute/v2.1/servers/dd9a2013-38fe-499c-a84e-97e2ca6e48ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:51:30.449671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:30.450414 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:30.458955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.459719 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.460955 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:30.461641 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:30.668909 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:30.677209 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9c67e720-9457-4513-bee8-2f250d858f5f tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1318 microversion: 2.1 time: 0.231406 Jun 16 17:51:30.677774 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 468/938] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:30 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:31.321575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:31.327041 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:31.334313 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:31.334900 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:31.335756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:31.336261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:31.371792 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:31.372346 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:31.372902 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lazy-loading 'fault' on Instance uuid 490551e2-1558-44c9-b3f8-220b4f1353e7 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:51:31.423828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:31.453395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-51d7fa6d-4fed-4f94-aa8b-578517caff5a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 200 len: 1304 microversion: 2.1 time: 0.134729 Jun 16 17:51:31.456913 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 471/939] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:31 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:31.701621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:31.702250 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:31.711210 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:31.711700 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:31.712731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:31.713164 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:32.206317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:32.215313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-77391d9c-6959-47a7-a01a-13603f73a7c3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1507 microversion: 2.1 time: 0.525260 Jun 16 17:51:32.216549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 469/940] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:31 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:32.475536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:32.477860 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 490551e2-1558-44c9-b3f8-220b4f1353e7] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:32.487785 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:32.488724 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:32.489824 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:32.490536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:32.496502 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:32.509886 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] HTTP exception thrown: Instance 490551e2-1558-44c9-b3f8-220b4f1353e7 could not be found. Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Request method failure captured: Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 HTTP/1.1 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22QKAxM1FjuB8ZD7K72KP1scdTlhV3KE5jMpIr74uXweHzdzCTm5MpbIjsjtyduKqAXCp0DzLJ7X_IrXho36pOl7BwamwlhIh5KBjJOeeG9EKDUHhhiWVNny6uzCdhxqv6-O7prXGLnXUGPd3AmygTJsCxHpziq5wZqijg_J2-CGE4 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: c6a903cccbd4459288d72e52410ffca1 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesActionsTest-1215953527 Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:32.513251 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6a903cccbd4459288d72e52410ffca1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c6a903cccbd4459288d72e52410ffca1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c6a903cccbd4459288d72e52410ffca1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6a903cccbd4459288d72e52410ffca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesActionsTest-1215953527 Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: c6a903cccbd4459288d72e52410ffca1 Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesActionsTest-1215953527 Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesActionsTest-1215953527-project Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: c4bffefe8fb2475a96ea033d07c790f2 Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesActionsTest-1215953527-project Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 490551e2-1558-44c9-b3f8-220b4f1353e7 could not be found. Jun 16 17:51:32.514659 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '490551e2-1558-44c9-b3f8-220b4f1353e7'} Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490551e2-1558-44c9-b3f8-220b4f1353e7 could not be found. Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:32.515422 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490551e2-1558-44c9-b3f8-220b4f1353e7 could not be found. Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490551e2-1558-44c9-b3f8-220b4f1353e7 could not be found. Jun 16 17:51:32.516631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:32.517782 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Returning 404 to user: Instance 490551e2-1558-44c9-b3f8-220b4f1353e7 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:32.517782 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3284f4cb-720a-41a0-b448-c3c7e97dd483 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7" status: 404 len: 111 microversion: 2.1 time: 0.047449 Jun 16 17:51:32.517782 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 472/941] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:32 2022] GET /compute/v2.1/servers/490551e2-1558-44c9-b3f8-220b4f1353e7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:32.633746 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1305106220", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "networks": [{"uuid": "23cca9b9-31dc-45f8-b4b9-f0d16fd7706a"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:32.711654 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] validate_networks() for [('23cca9b9-31dc-45f8-b4b9-f0d16fd7706a', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:51:33.408123 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:51:33.408668 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:51:33.411396 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:51:33.411927 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:51:33.412561 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:51:33.422567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:33.423031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:33.423840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:33.424281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:33.444802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Getting quotas for project c6a903cccbd4459288d72e52410ffca1. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:51:33.449140 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Getting quotas for user c4bffefe8fb2475a96ea033d07c790f2 and project c6a903cccbd4459288d72e52410ffca1. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:51:33.463987 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:51:33.466702 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:51:33.518420 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-33c45399-43a2-4462-8ba7-d145266b30b5 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889971 Jun 16 17:51:33.524594 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 470/942] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:51:33.531634 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d45216f7-e619-4f85-a52a-943972496752 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:33.532257 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d45216f7-e619-4f85-a52a-943972496752 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:33.600811 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d45216f7-e619-4f85-a52a-943972496752 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:33.607881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d45216f7-e619-4f85-a52a-943972496752 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1214 microversion: 2.1 time: 0.081702 Jun 16 17:51:33.608543 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 473/943] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:33 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:34.625935 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:34.627105 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:34.635370 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:34.636009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:34.637234 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:34.637878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:34.721480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:34.732740 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e85b038b-9436-4aad-ac2e-9f586e34b9fc tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1266 microversion: 2.1 time: 0.110555 Jun 16 17:51:34.733871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 471/944] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:34 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:35.756576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:35.757303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:35.765205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:35.765835 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:35.766599 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:35.767042 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:36.016093 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:36.027471 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4d1843df-ef0f-4857-94c6-229e5605521a tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.278231 Jun 16 17:51:36.036517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 474/945] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:35 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:36.037084 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f6d124ff-8c57-4a98-8aa3-2a8d26aba613 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Action: 'create', calling method: .version_select at 0x7f288c1cd160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1749544182"}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:36.397244 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-1acec854-d686-4014-b415-0437154d4a72 req-afe36986-ac82-43b3-8b8e-f3c44089831f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cf9755-c4f0-4589-8394-945c6ace6f4b", "tag": "b383da63-b575-49dd-9ceb-e747b879be8a"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:36.405066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1acec854-d686-4014-b415-0437154d4a72 req-afe36986-ac82-43b3-8b8e-f3c44089831f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:36.405774 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1acec854-d686-4014-b415-0437154d4a72 req-afe36986-ac82-43b3-8b8e-f3c44089831f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:36.418013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-1acec854-d686-4014-b415-0437154d4a72 req-afe36986-ac82-43b3-8b8e-f3c44089831f service nova] Creating event network-changed:b383da63-b575-49dd-9ceb-e747b879be8a for instance 09cf9755-c4f0-4589-8394-945c6ace6f4b on hv-cinder-83754 Jun 16 17:51:36.422560 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-1acec854-d686-4014-b415-0437154d4a72 req-afe36986-ac82-43b3-8b8e-f3c44089831f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030659 Jun 16 17:51:36.423665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 475/946] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:37.046230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:37.046939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:37.056279 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:37.056905 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:37.057809 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:37.060044 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:37.195612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:37.203058 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6261831b-c4cf-4529-9b73-bd3188faece2 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.161580 Jun 16 17:51:37.203622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 476/947] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:37 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:51:37.415135 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f6d124ff-8c57-4a98-8aa3-2a8d26aba613 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.531259 Jun 16 17:51:37.415781 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 472/948] 10.222.0.42 () {60 vars in 1154 bytes} [Thu Jun 16 17:51:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1533 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 17:51:37.432354 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c40ed851-85eb-4090-8672-484a4985dd7f tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c193040>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:37.486593 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c40ed851-85eb-4090-8672-484a4985dd7f tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 200 len: 345 microversion: 2.1 time: 0.058428 Jun 16 17:51:37.492859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 477/949] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:37 2022] GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:38.223258 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:38.223894 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:38.233816 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:38.234272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:38.235070 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:38.235542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:38.501525 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-05bba793-c65e-429e-88f6-a9b63d371de5 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c0b4ca0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:38.556570 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-05bba793-c65e-429e-88f6-a9b63d371de5 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 200 len: 346 microversion: 2.1 time: 0.059711 Jun 16 17:51:38.557327 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:38.557802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 478/950] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:38 2022] GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:38.565042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3a5dce91-4b6a-4c5c-aa51-a9e79fa00260 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.347448 Jun 16 17:51:38.568406 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 473/951] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:38 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:38.569295 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bd6ce41a-f13b-4fda-9319-92c8bff82000 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Action: 'create', calling method: .version_select at 0x7f287ff13f70>, body: {"snapshot": {"volume_id": "f88d24ba-8557-4105-8015-4ab2e717ab33", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1662503779"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:38.731727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bd6ce41a-f13b-4fda-9319-92c8bff82000 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.166643 Jun 16 17:51:38.732633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 479/952] 10.222.0.42 () {60 vars in 1161 bytes} [Thu Jun 16 17:51:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:38.742614 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3ebfb709-c97d-4579-800e-cbed4d31b2ce tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c139280>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:38.775523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3ebfb709-c97d-4579-800e-cbed4d31b2ce tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 200 len: 287 microversion: 2.1 time: 0.036694 Jun 16 17:51:38.776082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 474/953] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:38 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:38.786291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-f51bcdb9-63eb-4726-bbaa-a70b3ff40eb2 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f287ffdc1f0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:38.819654 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-f51bcdb9-63eb-4726-bbaa-a70b3ff40eb2 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037483 Jun 16 17:51:38.820227 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 480/954] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Jun 16 17:51:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:38.833683 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a501dd2d-b155-4f92-92a3-fcea71407c22 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c0e4940>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:38.869981 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a501dd2d-b155-4f92-92a3-fcea71407c22 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 200 len: 287 microversion: 2.1 time: 0.042742 Jun 16 17:51:38.870756 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 475/955] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:38 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:39.582727 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:39.583352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:39.589556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:39.590023 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:39.590787 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:39.591230 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:39.719089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:39.727043 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a0c92c29-5d82-410a-b29c-59551ab661a1 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.148978 Jun 16 17:51:39.727604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 481/956] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:39 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:39.884309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-486bc14f-a94a-4588-9334-5bc2c836f3e7 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c0fd9d0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:39.915020 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-486bc14f-a94a-4588-9334-5bc2c836f3e7 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 200 len: 287 microversion: 2.1 time: 0.035082 Jun 16 17:51:39.915574 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 476/957] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:39 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:51:40.743611 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:40.744226 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:40.751004 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:40.751661 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:40.752537 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:40.752965 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:40.886060 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:40.894563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-d518543d-ea00-467c-a2c3-530c4032cf26 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.154676 Jun 16 17:51:40.895152 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 482/958] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:40 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:40.927933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f916bc44-7a29-41c9-9d94-0ccc4d45d742 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c139d30>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:40.959780 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f916bc44-7a29-41c9-9d94-0ccc4d45d742 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 200 len: 287 microversion: 2.1 time: 0.036725 Jun 16 17:51:40.960601 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 477/959] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:40 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:41.911253 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:41.911960 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:41.918327 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:41.918773 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:41.919534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:41.919969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:41.971831 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-393baa35-fb4f-4cd1-a7ef-a57843da9c3f tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c0fdd30>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:42.002572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-393baa35-fb4f-4cd1-a7ef-a57843da9c3f tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 200 len: 288 microversion: 2.1 time: 0.035175 Jun 16 17:51:42.003141 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 478/960] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:41 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:42.014241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d1cd316c-f495-4287-a866-aa41bff120af tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c1da1f0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:42.060512 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:42.072135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a8888ba6-6aed-4c85-ad62-7fa89313765b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.164861 Jun 16 17:51:42.072955 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 483/961] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:41 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:42.088540 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d1cd316c-f495-4287-a866-aa41bff120af tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 202 len: 0 microversion: 2.1 time: 0.078113 Jun 16 17:51:42.089142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 479/962] 10.222.0.42 () {58 vars in 1253 bytes} [Thu Jun 16 17:51:42 2022] DELETE /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:51:42.097428 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-18936470-7c9f-4597-8c08-185ee0e9a333 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c053af0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:42.129871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-18936470-7c9f-4597-8c08-185ee0e9a333 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 200 len: 287 microversion: 2.1 time: 0.035707 Jun 16 17:51:42.130447 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 484/963] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:42 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:43.091600 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:43.092309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:43.099693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:43.100142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:43.100951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:43.101391 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:43.142379 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2a40733e-f7b5-4ca8-9bbc-83dd280df2ad tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c0a8040>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:43.174353 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-2a40733e-f7b5-4ca8-9bbc-83dd280df2ad tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] HTTP exception thrown: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2a40733e-f7b5-4ca8-9bbc-83dd280df2ad tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Request method failure captured: Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd HTTP/1.1 Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22njDwALbiBJpdpZktuFUgAkmA4w466Ui0Z5YRDI1Ty4oGvsbweKm7BCDBB5dOyiFWqanysAoKli7P9dYrdLamBvDVNIpklZ10ef3H09HrTJLZzYfy2chbGPLM7NZuvPgsQxLKNDAUgT0HoejEQsPn3esROwupQInNuaZPrJkeAXfY Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:43.176759 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c2eb3d7f65a4f80999395271ed2c850", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: a2f25294bba44cf8a5aaeafce5f63815 Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '6a3daddc-1899-4147-8a17-b759393989cd'} Jun 16 17:51:43.178531 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. (HTTP 404) (Request-ID: req-68a042ea-7ba4-4751-b35e-3517b1a2a6d2) Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.180068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:43.183119 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 17:51:43.185458 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2a40733e-f7b5-4ca8-9bbc-83dd280df2ad tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Returning 404 to user: Snapshot 6a3daddc-1899-4147-8a17-b759393989cd could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2a40733e-f7b5-4ca8-9bbc-83dd280df2ad tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd" status: 404 len: 111 microversion: 2.1 time: 0.040581 Jun 16 17:51:43.188465 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 485/964] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jun 16 17:51:43 2022] GET /compute/v2.1/os-snapshots/6a3daddc-1899-4147-8a17-b759393989cd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:43.190772 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-61ae8030-094c-4154-847b-2959f17d5b7e tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f287ff701f0>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:43.246304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:43.256208 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-63163ac1-f5e0-4859-a65a-cc772953c454 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.168706 Jun 16 17:51:43.256404 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 480/965] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:43 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:43.259321 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-61ae8030-094c-4154-847b-2959f17d5b7e tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 202 len: 0 microversion: 2.1 time: 0.075688 Jun 16 17:51:43.259897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 486/966] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:51:43 2022] DELETE /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:51:43.268332 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-8391197e-3066-4ae0-8be7-ad011b609b46 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c1da940>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:43.323506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-8391197e-3066-4ae0-8be7-ad011b609b46 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 200 len: 345 microversion: 2.1 time: 0.058395 Jun 16 17:51:43.324078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 481/967] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:43 2022] GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:43.932656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:43.937134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-755720fe-b70c-4f0c-8ca1-cc5d9757158b req-032400a1-5f59-48a3-928f-9efc8806ab8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cf9755-c4f0-4589-8394-945c6ace6f4b", "name": "network-vif-plugged", "status": "completed", "tag": "b383da63-b575-49dd-9ceb-e747b879be8a"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:43.947461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-755720fe-b70c-4f0c-8ca1-cc5d9757158b req-032400a1-5f59-48a3-928f-9efc8806ab8e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:43.948066 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-755720fe-b70c-4f0c-8ca1-cc5d9757158b req-032400a1-5f59-48a3-928f-9efc8806ab8e service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:43.961425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-755720fe-b70c-4f0c-8ca1-cc5d9757158b req-032400a1-5f59-48a3-928f-9efc8806ab8e service nova] Creating event network-vif-plugged:b383da63-b575-49dd-9ceb-e747b879be8a for instance 09cf9755-c4f0-4589-8394-945c6ace6f4b on hv-cinder-83754 Jun 16 17:51:43.966344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-755720fe-b70c-4f0c-8ca1-cc5d9757158b req-032400a1-5f59-48a3-928f-9efc8806ab8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034424 Jun 16 17:51:43.967482 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 487/968] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:44.270126 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:44.270895 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:44.276056 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:44.276703 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:44.284650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:44.285104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:44.285889 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:44.286321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:44.337556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-215cea2d-2eef-430b-9bee-3c90178f6030 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c270670>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:44.370021 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-215cea2d-2eef-430b-9bee-3c90178f6030 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] HTTP exception thrown: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-215cea2d-2eef-430b-9bee-3c90178f6030 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Request method failure captured: Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 HTTP/1.1 Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22njDwALbiBJpdpZktuFUgAkmA4w466Ui0Z5YRDI1Ty4oGvsbweKm7BCDBB5dOyiFWqanysAoKli7P9dYrdLamBvDVNIpklZ10ef3H09HrTJLZzYfy2chbGPLM7NZuvPgsQxLKNDAUgT0HoejEQsPn3esROwupQInNuaZPrJkeAXfY Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:44.374910 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c2eb3d7f65a4f80999395271ed2c850", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: a2f25294bba44cf8a5aaeafce5f63815 Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'f88d24ba-8557-4105-8015-4ab2e717ab33'} Jun 16 17:51:44.376517 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. (HTTP 404) (Request-ID: req-41cf3448-8fee-49c6-ba7f-aa244207316e) Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.377469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:44.379535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:51:44.381404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-215cea2d-2eef-430b-9bee-3c90178f6030 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Returning 404 to user: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-215cea2d-2eef-430b-9bee-3c90178f6030 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 404 len: 109 microversion: 2.1 time: 0.045400 Jun 16 17:51:44.382665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 488/969] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:44 2022] GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:51:44.394979 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4fb7243b-65b5-4032-9fed-f45d7d59fe03 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c177f70>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:44.429505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-4fb7243b-65b5-4032-9fed-f45d7d59fe03 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] HTTP exception thrown: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4fb7243b-65b5-4032-9fed-f45d7d59fe03 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Request method failure captured: Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 HTTP/1.1 Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22njDwALbiBJpdpZktuFUgAkmA4w466Ui0Z5YRDI1Ty4oGvsbweKm7BCDBB5dOyiFWqanysAoKli7P9dYrdLamBvDVNIpklZ10ef3H09HrTJLZzYfy2chbGPLM7NZuvPgsQxLKNDAUgT0HoejEQsPn3esROwupQInNuaZPrJkeAXfY Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:44.431556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c2eb3d7f65a4f80999395271ed2c850", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: a2f25294bba44cf8a5aaeafce5f63815 Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'f88d24ba-8557-4105-8015-4ab2e717ab33'} Jun 16 17:51:44.432904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. (HTTP 404) (Request-ID: req-d906f3a7-ba8b-4cbd-bc32-c5e9a7ff38f1) Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.433722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:51:44.434873 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:51:44.436089 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4fb7243b-65b5-4032-9fed-f45d7d59fe03 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Returning 404 to user: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:44.437303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4fb7243b-65b5-4032-9fed-f45d7d59fe03 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 404 len: 109 microversion: 2.1 time: 0.042011 Jun 16 17:51:44.438145 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:44.438261 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 489/970] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jun 16 17:51:44 2022] DELETE /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:51:44.441853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-754457ef-68fc-4204-9aec-4040d7bca0a4 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Calling method '.version_select at 0x7f288c0a8c10>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:44.444782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-740be83c-f478-4cf2-81b2-5b32814f6351 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1314 microversion: 2.1 time: 0.175568 Jun 16 17:51:44.445356 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 482/971] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:44 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:44.470755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-754457ef-68fc-4204-9aec-4040d7bca0a4 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] HTTP exception thrown: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-754457ef-68fc-4204-9aec-4040d7bca0a4 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Request method failure captured: Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 HTTP/1.1 Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22njDwALbiBJpdpZktuFUgAkmA4w466Ui0Z5YRDI1Ty4oGvsbweKm7BCDBB5dOyiFWqanysAoKli7P9dYrdLamBvDVNIpklZ10ef3H09HrTJLZzYfy2chbGPLM7NZuvPgsQxLKNDAUgT0HoejEQsPn3esROwupQInNuaZPrJkeAXfY Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:51:44.472816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c2eb3d7f65a4f80999395271ed2c850", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c2eb3d7f65a4f80999395271ed2c850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 6c2eb3d7f65a4f80999395271ed2c850 Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-372836690 Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: a2f25294bba44cf8a5aaeafce5f63815 Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesSnapshotsTestJSON-372836690-project Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': 'f88d24ba-8557-4105-8015-4ab2e717ab33'} Jun 16 17:51:44.474962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. (HTTP 404) (Request-ID: req-734650ef-0938-487f-bc7c-0ffff49bd921) Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.475929 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:51:44.477399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:51:44.479025 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-754457ef-68fc-4204-9aec-4040d7bca0a4 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] Returning 404 to user: Volume f88d24ba-8557-4105-8015-4ab2e717ab33 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-754457ef-68fc-4204-9aec-4040d7bca0a4 tempest-VolumesSnapshotsTestJSON-372836690 tempest-VolumesSnapshotsTestJSON-372836690-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33" status: 404 len: 109 microversion: 2.1 time: 0.037036 Jun 16 17:51:44.480488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 490/972] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jun 16 17:51:44 2022] GET /compute/v2.1/os-volumes/f88d24ba-8557-4105-8015-4ab2e717ab33 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:45.466539 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:45.467181 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:45.474795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:45.475251 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:45.477596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:45.478202 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:45.617924 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:45.625817 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-095b0f32-9ef3-47b7-99bc-0cca26d11714 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1497 microversion: 2.1 time: 0.163910 Jun 16 17:51:45.626340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 483/973] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:45 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:46.202644 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:46.203240 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:46.212109 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:46.212903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:46.213953 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:46.215821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:46.256664 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:51:46.395842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2261f8d3-cc5b-4a4b-9ee4-67f9e7b1d396 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "DELETE /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 204 len: 0 microversion: 2.1 time: 0.197437 Jun 16 17:51:46.396689 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 491/974] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:51:46 2022] DELETE /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:51:46.405805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:46.406600 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:46.413480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:46.414340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:46.415429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:46.415875 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:46.609006 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:46.618303 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5c5fec14-f346-4dec-9925-dc5ec52d238b tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1503 microversion: 2.1 time: 0.216976 Jun 16 17:51:46.619982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 484/975] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:46 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:47.638461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:47.639151 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:47.646514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:47.646974 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:47.647755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:47.648200 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:47.784666 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:47.793815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-feee5498-7a67-4ad5-98cc-57792ae3a367 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1503 microversion: 2.1 time: 0.159840 Jun 16 17:51:47.794545 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 492/976] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:47 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:48.733170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-fa4e97c3-017e-47ca-a5c6-8d3f9ebb8648 req-552fe81f-5a84-4a87-98fc-9359ca046490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cf9755-c4f0-4589-8394-945c6ace6f4b", "name": "network-vif-deleted", "tag": "b383da63-b575-49dd-9ceb-e747b879be8a"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:48.744577 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-fa4e97c3-017e-47ca-a5c6-8d3f9ebb8648 req-552fe81f-5a84-4a87-98fc-9359ca046490 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:48.745325 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-fa4e97c3-017e-47ca-a5c6-8d3f9ebb8648 req-552fe81f-5a84-4a87-98fc-9359ca046490 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:48.757516 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-fa4e97c3-017e-47ca-a5c6-8d3f9ebb8648 req-552fe81f-5a84-4a87-98fc-9359ca046490 service nova] Creating event network-vif-deleted:b383da63-b575-49dd-9ceb-e747b879be8a for instance 09cf9755-c4f0-4589-8394-945c6ace6f4b on hv-cinder-83754 Jun 16 17:51:48.775582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-fa4e97c3-017e-47ca-a5c6-8d3f9ebb8648 req-552fe81f-5a84-4a87-98fc-9359ca046490 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Jun 16 17:51:48.776477 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 485/977] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:51:48.811244 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:48.811872 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:48.821037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:48.821037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:48.821037 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:48.821306 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:48.900532 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bffefe8fb2475a96ea033d07c790f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a903cccbd4459288d72e52410ffca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:51:48.908115 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e7eb969a-9a0f-4238-8520-81f37b0c5e66 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 200 len: 1299 microversion: 2.1 time: 0.101475 Jun 16 17:51:48.908746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 493/978] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:48 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:51:49.928176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:51:49.928602 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] [instance: 09cf9755-c4f0-4589-8394-945c6ace6f4b] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:49.935305 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:49.935763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:49.936596 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:49.937230 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:49.951375 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] HTTP exception thrown: Instance 09cf9755-c4f0-4589-8394-945c6ace6f4b could not be found. Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Request method failure captured: Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b HTTP/1.1 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq22QKAxM1FjuB8ZD7K72KP1scdTlhV3KE5jMpIr74uXweHzdzCTm5MpbIjsjtyduKqAXCp0DzLJ7X_IrXho36pOl7BwamwlhIh5KBjJOeeG9EKDUHhhiWVNny6uzCdhxqv6-O7prXGLnXUGPd3AmygTJsCxHpziq5wZqijg_J2-CGE4 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: c6a903cccbd4459288d72e52410ffca1 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-VolumesActionsTest-1215953527 Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:51:49.953067 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6a903cccbd4459288d72e52410ffca1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c6a903cccbd4459288d72e52410ffca1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c6a903cccbd4459288d72e52410ffca1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6a903cccbd4459288d72e52410ffca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-VolumesActionsTest-1215953527 Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: c6a903cccbd4459288d72e52410ffca1 Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-VolumesActionsTest-1215953527 Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-VolumesActionsTest-1215953527-project Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: c4bffefe8fb2475a96ea033d07c790f2 Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-VolumesActionsTest-1215953527-project Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 09cf9755-c4f0-4589-8394-945c6ace6f4b could not be found. Jun 16 17:51:49.954405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '09cf9755-c4f0-4589-8394-945c6ace6f4b'} Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cf9755-c4f0-4589-8394-945c6ace6f4b could not be found. Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:51:49.955179 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cf9755-c4f0-4589-8394-945c6ace6f4b could not be found. Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cf9755-c4f0-4589-8394-945c6ace6f4b could not be found. Jun 16 17:51:49.956568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:51:49.958472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] Returning 404 to user: Instance 09cf9755-c4f0-4589-8394-945c6ace6f4b could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:51:49.958472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c79abd23-c280-4cf1-86cf-f2cf02ac8319 tempest-VolumesActionsTest-1215953527 tempest-VolumesActionsTest-1215953527-project] 10.222.0.42 "GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b" status: 404 len: 111 microversion: 2.1 time: 0.032968 Jun 16 17:51:49.958472 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 486/979] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:51:49 2022] GET /compute/v2.1/servers/09cf9755-c4f0-4589-8394-945c6ace6f4b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:59.286101 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "550b315c-6d0b-4857-861e-3f7394fa7b1c", "device": "/dev/sdb"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:51:59.287710 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:51:59.291896 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:59.302562 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:59.312143 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:59.313539 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:59.314451 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:51:59.315003 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:51:59.794295 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-94be4126-81ed-411f-a2ec-9ce67eb7de73 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "POST /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513082 Jun 16 17:51:59.796676 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 494/980] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:51:59 2022] POST /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:52:10.018098 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:10.020797 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=88 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:10.304657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1c88a4ad-8f7c-4f6b-8b03-a60123c7ec30 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Action: 'create', calling method: .version_select at 0x7f288c0fdaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-988845154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbF18bSS8Pzap+o1cTbx4PUN0pFMcWBjnpanwWUoqSx8gR/wIBDcD2bDT/wr/H83+3zfl3f0qL1olojwFKqQ7gqsZCVDcVk1bkiJElBFuf1NLgGdLHfzhXR8cmbVsO7qg=="}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:10.355582 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-1c88a4ad-8f7c-4f6b-8b03-a60123c7ec30 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for project 9c249c315494483892639b1213d4bc5d. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:52:10.360711 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-1c88a4ad-8f7c-4f6b-8b03-a60123c7ec30 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for user 31e04db1b0f6444e9a884a0e58ba38da and project 9c249c315494483892639b1213d4bc5d. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:52:10.400533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1c88a4ad-8f7c-4f6b-8b03-a60123c7ec30 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.387187 Jun 16 17:52:10.402024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 487/981] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:52:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:52:26.815828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:26.817007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:26.821340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:26.821925 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:26.830711 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:26.831170 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:26.832134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:26.832908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:26.922979 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lazy-loading 'services' on Instance uuid 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:52:27.009002 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-96d76320-3af0-46d1-b7c4-c059a4e40f4a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f/os-volume_attachments/550b315c-6d0b-4857-861e-3f7394fa7b1c" status: 202 len: 0 microversion: 2.1 time: 0.194313 Jun 16 17:52:27.009803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 495/982] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:52:26 2022] DELETE /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f/os-volume_attachments/550b315c-6d0b-4857-861e-3f7394fa7b1c => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:52:28.147580 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=4 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:28.148331 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:28.152829 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:28.153346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:28.165651 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:28.166112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:28.166942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:28.167388 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:28.194293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:52:28.299397 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-da5056c0-6334-4093-8dfe-b6c6a9a0c249 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 204 len: 0 microversion: 2.1 time: 0.152437 Jun 16 17:52:28.300575 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 488/983] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:52:28 2022] DELETE /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:52:28.312473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:28.314524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:28.325977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:28.326832 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:28.328409 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:28.329201 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:28.528120 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:28.535899 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ec5a27ec-c020-4f67-b6b6-d6622f753da3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1513 microversion: 2.1 time: 0.228748 Jun 16 17:52:28.537464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 496/984] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:28 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:29.556078 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:29.557044 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:29.563927 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:29.564670 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:29.565525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:29.566000 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:29.719571 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:29.731650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9ec9bade-29e2-46e9-85e9-e9a3ffe48ab2 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1513 microversion: 2.1 time: 0.176213 Jun 16 17:52:29.731650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 489/985] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:29 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:30.736473 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-5db560eb-8d6a-422f-bde5-f088d35aea3f req-72338468-6c99-4a2c-9d31-24dafd2fcbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f", "name": "network-vif-deleted", "tag": "7f7361c5-43ed-41b5-98cd-1d49941f3a74"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:30.746980 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:30.747544 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5db560eb-8d6a-422f-bde5-f088d35aea3f req-72338468-6c99-4a2c-9d31-24dafd2fcbb5 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:30.747544 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-5db560eb-8d6a-422f-bde5-f088d35aea3f req-72338468-6c99-4a2c-9d31-24dafd2fcbb5 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:30.748586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:30.756550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:30.757398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:30.758758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:30.759433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:30.763694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-5db560eb-8d6a-422f-bde5-f088d35aea3f req-72338468-6c99-4a2c-9d31-24dafd2fcbb5 service nova] Creating event network-vif-deleted:7f7361c5-43ed-41b5-98cd-1d49941f3a74 for instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f on hv-cinder-83754 Jun 16 17:52:30.772586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-5db560eb-8d6a-422f-bde5-f088d35aea3f req-72338468-6c99-4a2c-9d31-24dafd2fcbb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037817 Jun 16 17:52:30.775243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 497/986] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:52:30.836405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:30.848364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d24d5c75-f284-4723-b187-b75878a5d21a tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 200 len: 1471 microversion: 2.1 time: 0.107353 Jun 16 17:52:30.849905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 490/987] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:30 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 1471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:31.871244 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:31.871954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:31.878225 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:31.878685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:31.879462 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:31.880904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:31.894933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] HTTP exception thrown: Instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f could not be found. Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Request method failure captured: Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f HTTP/1.1 Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22Ryt86qopYxEznL3aAVJ7j9eVSIqK7a8OPlReqaerHNoSyT-40qGWjdLXHmAAWYKzXgZJ7qjs1yeNvpkD0kGjo_hHd5LHpuEubK-9JgRbSOqiaBRIADO5IMo8zCfmIIayPsU_lkPCAgPwWOpafWEpmytPtb-hA4RmUWWadC3-oM1I Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 55704b6435104c8e958ae6c5bb202f24 Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesSnapshotTestJSON-671345733 Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:52:31.897403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55704b6435104c8e958ae6c5bb202f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55704b6435104c8e958ae6c5bb202f24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55704b6435104c8e958ae6c5bb202f24", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55704b6435104c8e958ae6c5bb202f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesSnapshotTestJSON-671345733 Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 55704b6435104c8e958ae6c5bb202f24 Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-671345733 Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesSnapshotTestJSON-671345733-project Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 0824d8df380e477b85690814b0a2a9e3 Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesSnapshotTestJSON-671345733-project Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f could not be found. Jun 16 17:52:31.900114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f'} Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f could not be found. Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:52:31.901866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f could not be found. Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f could not be found. Jun 16 17:52:31.904694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:52:31.906256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Returning 404 to user: Instance 6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:52:31.906256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-07bd6056-351c-4f26-94ea-07cc5edaa2b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f" status: 404 len: 111 microversion: 2.1 time: 0.034436 Jun 16 17:52:31.906256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 498/988] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:31 2022] GET /compute/v2.1/servers/6d7fa0aa-ad6b-4485-a2f1-f26f95fb7f7f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:52:41.811035 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-855498173", "imageRef": "c5680095-12c6-4232-82d8-6f0fae739ad8", "flavorRef": "452", "networks": [{"uuid": "c548a7ca-f4a7-4021-974b-b75ad485bd67"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:41.818484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:41.819784 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:41.870229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] validate_networks() for [('c548a7ca-f4a7-4021-974b-b75ad485bd67', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:52:42.504249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:52:42.504730 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:52:42.505272 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:52:42.505694 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:52:42.506113 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:52:42.516731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:42.517229 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:42.518216 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:42.518776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:42.536982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Getting quotas for project 55704b6435104c8e958ae6c5bb202f24. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:52:42.541023 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Getting quotas for user 0824d8df380e477b85690814b0a2a9e3 and project 55704b6435104c8e958ae6c5bb202f24. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:52:42.551927 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:52:42.554610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5680095-12c6-4232-82d8-6f0fae739ad8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:52:42.609873 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1344c7ce-a4b4-4450-967d-37fc020cb2f3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802913 Jun 16 17:52:42.610532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 491/989] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:52:42.620718 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-438c69c8-110a-4325-83bd-a3dcb3fe3416 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:42.621339 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-438c69c8-110a-4325-83bd-a3dcb3fe3416 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:42.624008 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=8 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:42.624685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:42.683178 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-438c69c8-110a-4325-83bd-a3dcb3fe3416 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:42.691029 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-438c69c8-110a-4325-83bd-a3dcb3fe3416 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1218 microversion: 2.1 time: 0.074035 Jun 16 17:52:42.691897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 499/990] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:42 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:43.708692 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:43.709313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:43.716392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:43.716866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:43.717640 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:43.718085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:43.783367 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:43.791447 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-dcd54419-a16a-4a3a-a7fb-76bf56f8d107 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1222 microversion: 2.1 time: 0.087132 Jun 16 17:52:43.792012 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 492/991] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:43 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:44.809508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:44.810252 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:44.817794 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:44.818247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:44.819114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:44.819573 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:44.884285 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:44.893329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-950bff60-c1ba-4df0-bd58-fd28dcdcdfa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1222 microversion: 2.1 time: 0.088429 Jun 16 17:52:44.893912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 500/992] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:44 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:45.910146 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:45.910988 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:45.918474 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:45.918920 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:45.919692 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:45.920132 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:45.983290 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:45.996989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-71ecc269-5fe5-4785-aa07-12835547901c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1270 microversion: 2.1 time: 0.090690 Jun 16 17:52:45.997493 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 493/993] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:45 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:47.014073 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:47.014685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:47.021147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:47.021597 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:47.022363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:47.022793 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:47.224211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:47.232721 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-664921f4-dee9-4100-9a7d-ca72f8123b16 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.222687 Jun 16 17:52:47.233300 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 501/994] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:47 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:47.708456 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1082199094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-988845154", "security_groups": [{"name": "tempest-secgroup-smoke-1490933338"}], "block_device_mapping_v2": [{"uuid": "fbb1e23b-0275-4200-a0d6-328502a63c85", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f9a2faf-961d-4809-b337-0b0a1287acd0"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:47.886007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-f8fd1919-3f7f-4e9d-ae59-b43da5784a49 req-f6083664-9271-4fcc-9eee-875887c5b14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d717b2-d743-407d-99fe-5f95c562d737", "tag": "94666f77-0d51-4e97-9999-1780be94ae53"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:47.897228 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-f8fd1919-3f7f-4e9d-ae59-b43da5784a49 req-f6083664-9271-4fcc-9eee-875887c5b14a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:47.898017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-f8fd1919-3f7f-4e9d-ae59-b43da5784a49 req-f6083664-9271-4fcc-9eee-875887c5b14a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:47.910990 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-f8fd1919-3f7f-4e9d-ae59-b43da5784a49 req-f6083664-9271-4fcc-9eee-875887c5b14a service nova] Creating event network-changed:94666f77-0d51-4e97-9999-1780be94ae53 for instance 30d717b2-d743-407d-99fe-5f95c562d737 on hv-cinder-83754 Jun 16 17:52:47.917386 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-f8fd1919-3f7f-4e9d-ae59-b43da5784a49 req-f6083664-9271-4fcc-9eee-875887c5b14a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037494 Jun 16 17:52:47.918478 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 502/995] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:52:47.965721 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] validate_networks() for [('6f9a2faf-961d-4809-b337-0b0a1287acd0', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:52:48.252302 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:48.253046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:48.260203 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:48.260679 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:48.261450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:48.261887 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:48.578288 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:48.586404 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1c2d4a37-a466-49da-930f-55f36b965bdd tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.338850 Jun 16 17:52:48.586983 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 503/996] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:48 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:52:48.689260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:52:48.689628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:52:48.690108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:52:48.690523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:52:48.690938 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:52:48.699750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:48.700206 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:48.701091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:48.701537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:48.721094 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for project 9c249c315494483892639b1213d4bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:52:48.725175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for user 31e04db1b0f6444e9a884a0e58ba38da and project 9c249c315494483892639b1213d4bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:52:48.784739 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:52:48.786776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbb1e23b-0275-4200-a0d6-328502a63c85',volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:52:48.934961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-979decf4-bae6-4a01-b612-2cff7739e17c tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.232463 Jun 16 17:52:48.935790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 494/997] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:52:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:52:48.945982 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-994fb1e3-4776-483f-ab6a-864c6b37d342 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:48.946543 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-994fb1e3-4776-483f-ab6a-864c6b37d342 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:49.017434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-994fb1e3-4776-483f-ab6a-864c6b37d342 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:49.025356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-994fb1e3-4776-483f-ab6a-864c6b37d342 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1094 microversion: 2.1 time: 0.083527 Jun 16 17:52:49.026320 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 504/998] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:48 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:49.604006 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:49.605015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:49.611895 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:49.612364 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:49.613378 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:49.614003 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:49.849886 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:49.857552 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4085990e-e3d9-40a1-a94b-5063065e578d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.258312 Jun 16 17:52:49.858042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 495/999] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:49 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:50.043744 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:50.044417 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:50.051784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:50.052247 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:50.053050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:50.054287 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:50.130898 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:50.152488 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-3b204b85-149c-4001-a3a1-960708fa8607 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1192 microversion: 2.1 time: 0.112713 Jun 16 17:52:50.160767 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 505/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:50 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1192 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:50.874465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:50.875085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:50.882053 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:50.882515 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:50.883307 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:50.883827 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:51.108149 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:51.117789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-95860761-b263-4f12-8759-e3f7e22ee455 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.247014 Jun 16 17:52:51.118760 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 496/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:50 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:51.182030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:51.184981 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:51.211685 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:51.213121 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:51.216445 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:51.217281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:51.500725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:51.514303 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-148e8229-8ccf-4a5a-b874-f979101f9d81 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.339172 Jun 16 17:52:51.516183 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 506/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:51 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:52.137116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:52.138133 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:52.145352 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:52.146049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:52.147205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:52.148313 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:52.179082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-54341e32-9171-4856-ad89-a86e801b398d req-c883c60a-d447-4284-89b8-8a756c5e6562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955d0309-09c6-4b7b-9238-c3fc7f72480f", "tag": "22e5764f-e79f-44af-878a-3414fd999055"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:52.189431 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-54341e32-9171-4856-ad89-a86e801b398d req-c883c60a-d447-4284-89b8-8a756c5e6562 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:52.191494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-54341e32-9171-4856-ad89-a86e801b398d req-c883c60a-d447-4284-89b8-8a756c5e6562 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:52.220600 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-54341e32-9171-4856-ad89-a86e801b398d req-c883c60a-d447-4284-89b8-8a756c5e6562 service nova] Creating event network-changed:22e5764f-e79f-44af-878a-3414fd999055 for instance 955d0309-09c6-4b7b-9238-c3fc7f72480f on hv-cinder-83754 Jun 16 17:52:52.227030 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-54341e32-9171-4856-ad89-a86e801b398d req-c883c60a-d447-4284-89b8-8a756c5e6562 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055487 Jun 16 17:52:52.228415 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 507/1003] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:52:52.467876 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:52.479671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3ba3dec8-cf5b-4516-a4fb-8b6e329b95b3 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.348118 Jun 16 17:52:52.480259 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 497/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:52 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:52.534700 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:52.535397 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:52.542546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:52.542996 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:52.543761 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:52.544196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:52.741009 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:52.749363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1fd9137b-2c15-422a-860f-311b987739eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.218823 Jun 16 17:52:52.756575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 508/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:52 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:53.348981 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-66fb8f67-b65e-4651-ada6-40ce15d3775d req-a8a8a15e-1ab2-41f8-a9db-4c0c0ecd83c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d717b2-d743-407d-99fe-5f95c562d737", "name": "network-vif-plugged", "status": "completed", "tag": "94666f77-0d51-4e97-9999-1780be94ae53"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:53.360242 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-66fb8f67-b65e-4651-ada6-40ce15d3775d req-a8a8a15e-1ab2-41f8-a9db-4c0c0ecd83c1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:53.361570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-66fb8f67-b65e-4651-ada6-40ce15d3775d req-a8a8a15e-1ab2-41f8-a9db-4c0c0ecd83c1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:53.383675 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-66fb8f67-b65e-4651-ada6-40ce15d3775d req-a8a8a15e-1ab2-41f8-a9db-4c0c0ecd83c1 service nova] Creating event network-vif-plugged:94666f77-0d51-4e97-9999-1780be94ae53 for instance 30d717b2-d743-407d-99fe-5f95c562d737 on hv-cinder-83754 Jun 16 17:52:53.392295 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-66fb8f67-b65e-4651-ada6-40ce15d3775d req-a8a8a15e-1ab2-41f8-a9db-4c0c0ecd83c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047828 Jun 16 17:52:53.393912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 498/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:52:53.497290 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:53.498725 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:53.505717 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:53.506212 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:53.507575 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:53.508028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:53.768489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:53.769202 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:53.777613 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:53.778079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:53.778941 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:53.779395 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:53.829357 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:53.839228 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-aacd5cdf-e06e-40da-a12e-42f082554fa4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.345699 Jun 16 17:52:53.839821 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 509/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:53 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:54.004553 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:54.013030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-6f11fb3c-4468-44e5-baa1-5e72bba48ecd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.248536 Jun 16 17:52:54.013595 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 499/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:53 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:54.855086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:54.855709 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:54.862205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:54.862658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:54.863441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:54.863883 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:55.002287 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:55.010525 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-98bf53ca-500b-41a8-9b6e-0069a57fe940 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1318 microversion: 2.1 time: 0.159390 Jun 16 17:52:55.011094 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 510/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:54 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:55.032536 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:55.033897 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:55.041869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:55.042480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:55.043405 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:55.043989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:55.174534 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:55.182868 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9926f762-ce68-456f-b2a5-3f05eae88ddc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.156060 Jun 16 17:52:55.183524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 500/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:55 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:56.027668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:56.028324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:56.034957 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:56.035426 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:56.036219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:56.036693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:56.199947 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:56.201163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:56.202278 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:56.207477 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:56.208128 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:56.209253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:56.210048 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:56.210938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7ffbadeb-68ca-4552-9cf6-05eab171a201 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1507 microversion: 2.1 time: 0.187025 Jun 16 17:52:56.211690 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 511/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:56 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:56.227757 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "591868ed-cede-49fb-8553-bbf42e896473", "device": "/dev/sdb"}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:52:56.229156 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:56.235378 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:56.235840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:56.236640 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:56.237269 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:56.450193 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:56.458999 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-55c6d0b8-eb87-4c9d-a504-b246f21389d7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.262695 Jun 16 17:52:56.460203 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 501/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:56 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:56.520160 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6749b98b-ce12-446b-9a17-f848087ec3b4 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "POST /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296736 Jun 16 17:52:56.520814 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 512/1013] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jun 16 17:52:56 2022] POST /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:52:57.477808 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:57.478416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:57.484930 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:57.485376 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:57.486137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:57.486573 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:57.632323 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:57.640204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fa783454-aba7-4b9e-87a1-51ec8b06a839 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.166702 Jun 16 17:52:57.640799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 502/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:57 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:58.657939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:58.658713 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:58.669430 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:58.669879 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:58.670670 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:58.671104 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:58.808347 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:58.815900 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-27004cc3-6e3e-49af-973d-3029f8152ff1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.162664 Jun 16 17:52:58.816494 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 513/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:58 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:52:59.832773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:52:59.833390 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:52:59.837127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=4 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:59.837888 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=12 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:59.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:59.842540 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:59.843326 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:52:59.843774 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:52:59.984751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:52:59.993245 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-87bee0b5-227c-42fe-b514-d929b0db82e1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.164315 Jun 16 17:52:59.993812 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 503/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:52:59 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:01.011038 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:01.011668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:01.013918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=4 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:01.020020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:01.020510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:01.021314 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:01.022279 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:01.155490 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:01.164204 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6b0eb0db-56db-4193-8d74-177a41dd45e0 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.157166 Jun 16 17:53:01.164811 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 514/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:01 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:02.186485 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:02.187104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:02.193650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:02.194102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:02.194860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:02.195304 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:02.330657 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:02.338926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-b87c4ddd-2b15-427f-b6d3-5522da971af6 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.156248 Jun 16 17:53:02.339499 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 504/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:02 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:03.355518 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:03.356434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:03.363505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:03.363967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:03.364795 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:03.365250 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:03.501978 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:03.510080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-6ab9a271-579e-44e5-8cc8-df5ea2a3de5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.158830 Jun 16 17:53:03.510655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 515/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:03 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:04.527193 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:04.527806 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:04.534443 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:04.534850 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:04.535627 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:04.536075 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:04.665588 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:04.673021 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-1db79db4-346c-4bd3-8903-46e08aeae3c3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.149782 Jun 16 17:53:04.673581 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 505/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:04 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:05.690421 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:05.690959 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:05.698032 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:05.698481 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:05.699249 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:05.699688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:05.831723 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:05.839950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-51bed806-c017-4ec4-8b6c-9ce39795e2b8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.153504 Jun 16 17:53:05.840556 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 516/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:05 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:06.856621 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:06.857247 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:06.863814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:06.864276 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:06.865163 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:06.865987 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:06.999542 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:07.007355 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-dc212c44-a77c-4ec6-8ce2-dfc63a1c0825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.154613 Jun 16 17:53:07.007919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 506/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:06 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:08.024059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:08.024631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:08.031724 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:08.032170 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:08.032969 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:08.033409 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:08.051356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:08.167513 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:08.174934 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-49ab864f-844e-477d-9cab-9c364d965f50 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.154827 Jun 16 17:53:08.175489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 517/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:08 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:09.192009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:09.192668 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:09.199527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:09.199986 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:09.200797 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:09.201244 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:09.339051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:09.346448 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-cac4ec6f-c737-4d44-bc80-7f14284e6cb5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.158312 Jun 16 17:53:09.347009 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 507/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:09 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:10.363467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:10.364087 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:10.371675 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:10.372126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:10.372928 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:10.373367 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:10.502945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:10.511346 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b9406054-a494-4843-b1ca-3065c4360d15 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.151737 Jun 16 17:53:10.511927 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 518/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:10 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:11.528267 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:11.528927 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:11.535586 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:11.536042 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:11.537419 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:11.538065 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:11.682609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:11.691018 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a01d630d-bc23-4d64-a971-439dbd95f9e4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.166642 Jun 16 17:53:11.691599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 508/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:11 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:12.708622 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:12.709376 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:12.711784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=45 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:12.717276 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:12.717726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:12.718499 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:12.718941 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:12.851991 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:12.859551 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-711dafdb-2522-49d9-b9ba-b00fd84081ac tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.154825 Jun 16 17:53:12.860110 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 519/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:12 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:13.876914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:13.877537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:13.879886 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:13.885778 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:13.886241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:13.887027 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:13.887471 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:13.891161 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=97 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:14.023173 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:14.030660 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f65d6229-c3c3-40b4-9b5e-0f4ade5dea6e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.157591 Jun 16 17:53:14.031221 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 509/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:13 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:15.048026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:15.048658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:15.055352 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:15.055798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:15.056581 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:15.057016 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:15.187482 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:15.195013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ed8612f3-3521-4f1e-8d48-10ccfb5b1c9d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.150908 Jun 16 17:53:15.195576 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 520/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:15 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:16.212186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:16.212815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:16.219379 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:16.219834 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:16.220646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:16.221091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:16.349475 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:16.356991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e5f0e24a-b2a8-4b65-ad72-8a9ac4d4a127 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.149261 Jun 16 17:53:16.357555 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 510/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:16 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:17.374638 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:17.375462 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:17.384584 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:17.385049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:17.385840 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:17.386284 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:17.558987 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:17.566447 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ca97ec76-f62f-4da4-9196-79874c1d7511 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.196678 Jun 16 17:53:17.568585 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 521/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:17 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:18.586191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:18.586904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:18.593878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:18.594576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:18.595497 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:18.596007 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:18.797912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:18.806982 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4c69e6cb-8c35-4681-bdb6-0d78012c5603 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.224567 Jun 16 17:53:18.807630 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 511/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:18 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:19.823871 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:19.824594 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:19.831161 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:19.831618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:19.832412 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:19.832861 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:19.979464 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:19.988801 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9cc14447-070e-4c21-aac7-4354edadc343 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.168903 Jun 16 17:53:19.989296 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 522/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:19 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:21.006928 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:21.007577 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:21.018352 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:21.018892 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:21.019687 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:21.020129 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:21.156517 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:21.164612 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a3796bc3-9ce2-4933-b245-a4b08896219d tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.162781 Jun 16 17:53:21.165172 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 512/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:21 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:22.182072 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:22.182705 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:22.190658 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:22.191420 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:22.192206 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:22.192693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:22.345655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:22.356558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-26092740-4b87-47c8-93b5-1968530683d3 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.178963 Jun 16 17:53:22.357140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 523/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:22 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:23.375519 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:23.376243 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:23.383765 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:23.384220 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:23.385028 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:23.385578 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:23.543373 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:23.551820 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a56b80a3-b97c-43a7-bb3e-29ab75b7d77f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.180795 Jun 16 17:53:23.552508 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 513/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:23 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:24.570425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:24.571036 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:24.577534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:24.577980 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:24.578737 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:24.579180 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:24.713810 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:24.721327 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e4925b16-5d37-4bdb-bfc5-180f4962cc65 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.155316 Jun 16 17:53:24.721893 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 524/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:24 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:25.739195 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:25.739743 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:25.747062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:25.747514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:25.748285 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:25.748751 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:25.883645 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:25.891392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-74a93f83-8972-448e-8081-49bcfc2611aa tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.156351 Jun 16 17:53:25.891983 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 514/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:25 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:26.908360 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:26.909012 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:26.916773 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:26.917233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:26.918000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:26.918438 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:27.052505 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:27.059998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ab9d32c2-563d-49b0-a68c-4d6a1e8c16f9 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.155504 Jun 16 17:53:27.060604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 525/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:26 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:28.076876 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:28.077485 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:28.084089 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:28.084570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:28.085440 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:28.085877 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:28.220205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:28.228255 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-84bfbadb-2034-4ca4-b9ed-e1405c37bad2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.155218 Jun 16 17:53:28.228904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 515/1040] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:28 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:29.246577 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:29.247214 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:29.253755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:29.254210 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:29.254980 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:29.255423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:29.385790 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:29.393722 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b4a0a6df-c076-4639-a77f-0dbbfd05680e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.151036 Jun 16 17:53:29.394297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 526/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:29 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:29.617529 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-b2056c45-60d2-46e0-abd1-4a51a9a5d946 req-d49d1063-54c6-4904-b68e-13ae6fc674b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955d0309-09c6-4b7b-9238-c3fc7f72480f", "name": "network-vif-plugged", "status": "completed", "tag": "22e5764f-e79f-44af-878a-3414fd999055"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:53:29.626170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b2056c45-60d2-46e0-abd1-4a51a9a5d946 req-d49d1063-54c6-4904-b68e-13ae6fc674b5 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:29.626731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b2056c45-60d2-46e0-abd1-4a51a9a5d946 req-d49d1063-54c6-4904-b68e-13ae6fc674b5 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:29.638489 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-b2056c45-60d2-46e0-abd1-4a51a9a5d946 req-d49d1063-54c6-4904-b68e-13ae6fc674b5 service nova] Creating event network-vif-plugged:22e5764f-e79f-44af-878a-3414fd999055 for instance 955d0309-09c6-4b7b-9238-c3fc7f72480f on hv-cinder-83754 Jun 16 17:53:29.643741 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-b2056c45-60d2-46e0-abd1-4a51a9a5d946 req-d49d1063-54c6-4904-b68e-13ae6fc674b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030691 Jun 16 17:53:29.644450 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 516/1042] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:53:30.411407 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:30.412026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:30.420064 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:30.420487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:30.421383 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:30.421756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:30.561918 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:30.569933 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-463a5f48-1936-4a4c-908e-432d44921e62 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.162318 Jun 16 17:53:30.570495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 527/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:30 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:53:31.587991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:31.588731 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:31.594864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:31.595321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:31.596095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:31.596565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:31.735055 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:31.743139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9b12ccda-3a74-4f5c-ad4c-dab830650f55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.159909 Jun 16 17:53:31.743706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 517/1044] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:31 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:32.761216 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:32.761834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:32.768915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:32.769374 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:32.770157 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:32.770604 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:32.911497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:32.919278 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-08548831-9fcb-4eb2-9088-c689efdb1b91 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.162937 Jun 16 17:53:32.919841 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 528/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:32 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:33.935589 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:33.936207 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:33.942736 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:33.943186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:33.943989 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:33.945091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:34.086939 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:34.094488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9847a0a4-27a1-4cd9-b12a-bcaa6be2fc9f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1266 microversion: 2.1 time: 0.162765 Jun 16 17:53:34.095074 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 518/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:33 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:35.111218 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:35.111834 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:35.119509 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:35.119964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:35.120763 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:35.121208 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:35.260059 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:35.267784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e9a38446-7107-4e37-bf3e-4a610c437f1e tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1453 microversion: 2.1 time: 0.160343 Jun 16 17:53:35.268356 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 529/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:35 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:35.284218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:35.284871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:35.291442 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:35.291899 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:35.292701 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:35.293150 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:35.421998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:35.431186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-83a9c5e7-467a-453b-ac1f-dfad6795f3fc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1453 microversion: 2.1 time: 0.150821 Jun 16 17:53:35.431758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 519/1048] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:35 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:36.935086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:36.935586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:36.941942 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:36.942430 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:36.943211 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:36.943657 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:37.036007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.objects.instance [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lazy-loading 'services' on Instance uuid 30d717b2-d743-407d-99fe-5f95c562d737 {{(pid=124157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:53:37.138331 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ee63689c-c74f-4cb7-9cdd-ff0a4f112f23 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737/os-volume_attachments/591868ed-cede-49fb-8553-bbf42e896473" status: 202 len: 0 microversion: 2.1 time: 0.206681 Jun 16 17:53:37.138954 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 530/1049] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jun 16 17:53:36 2022] DELETE /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737/os-volume_attachments/591868ed-cede-49fb-8553-bbf42e896473 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:53:37.544294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-d8de2a21-483f-4c54-9cc8-abca2582d3dd req-606695d1-10ad-4c72-a6c2-ba92815b1fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955d0309-09c6-4b7b-9238-c3fc7f72480f", "tag": "22e5764f-e79f-44af-878a-3414fd999055"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:53:37.559252 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-d8de2a21-483f-4c54-9cc8-abca2582d3dd req-606695d1-10ad-4c72-a6c2-ba92815b1fc6 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:37.559873 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-d8de2a21-483f-4c54-9cc8-abca2582d3dd req-606695d1-10ad-4c72-a6c2-ba92815b1fc6 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:37.571747 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-d8de2a21-483f-4c54-9cc8-abca2582d3dd req-606695d1-10ad-4c72-a6c2-ba92815b1fc6 service nova] Creating event network-changed:22e5764f-e79f-44af-878a-3414fd999055 for instance 955d0309-09c6-4b7b-9238-c3fc7f72480f on hv-cinder-83754 Jun 16 17:53:37.578346 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-d8de2a21-483f-4c54-9cc8-abca2582d3dd req-606695d1-10ad-4c72-a6c2-ba92815b1fc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241321 Jun 16 17:53:37.579638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 520/1050] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:53:38.286535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:38.287148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:38.299115 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:38.299580 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:38.300480 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:38.306985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:38.318081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:38.347856 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:53:38.447508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e2e7d0b2-6312-494c-b964-47ecf299584d tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 204 len: 0 microversion: 2.1 time: 0.169909 Jun 16 17:53:38.448601 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 531/1051] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:53:38 2022] DELETE /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:53:38.457796 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:38.464638 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:38.474227 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:38.474869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:38.477283 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:38.477811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:38.631869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:38.640339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3ddc001b-c013-41a3-a473-8d25a51ad01e tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1513 microversion: 2.1 time: 0.187291 Jun 16 17:53:38.640941 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 521/1052] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:38 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:39.659046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:39.659881 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:39.672746 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:39.673212 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:39.674017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:39.674515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:39.830602 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:39.839088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-74415d46-d242-4d90-85ef-0d5c7f54bf8c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1513 microversion: 2.1 time: 0.184172 Jun 16 17:53:39.839687 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 532/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:39 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:40.857175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:40.859365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:40.873449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:40.875120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:40.877914 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:40.878532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:41.293766 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:41.301716 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d006fa14-6f25-4c15-b05f-6ce90a60a4b0 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1513 microversion: 2.1 time: 0.448563 Jun 16 17:53:41.302902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 522/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:40 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:41.737293 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-b26b6a9d-3efb-42f4-9b32-5ff623a07e2b req-cfcb5e0a-9c8b-455c-8994-4e8da5c19ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d717b2-d743-407d-99fe-5f95c562d737", "name": "network-vif-deleted", "tag": "94666f77-0d51-4e97-9999-1780be94ae53"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:53:41.750088 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-b26b6a9d-3efb-42f4-9b32-5ff623a07e2b req-cfcb5e0a-9c8b-455c-8994-4e8da5c19ea4 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:41.750534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-b26b6a9d-3efb-42f4-9b32-5ff623a07e2b req-cfcb5e0a-9c8b-455c-8994-4e8da5c19ea4 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:41.769466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-b26b6a9d-3efb-42f4-9b32-5ff623a07e2b req-cfcb5e0a-9c8b-455c-8994-4e8da5c19ea4 service nova] Creating event network-vif-deleted:94666f77-0d51-4e97-9999-1780be94ae53 for instance 30d717b2-d743-407d-99fe-5f95c562d737 on hv-cinder-83754 Jun 16 17:53:41.777041 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-b26b6a9d-3efb-42f4-9b32-5ff623a07e2b req-cfcb5e0a-9c8b-455c-8994-4e8da5c19ea4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043131 Jun 16 17:53:41.777985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 533/1055] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:53:42.333506 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:42.336912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:42.368857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:42.369646 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:42.370770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:42.371439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:42.421527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:42.422058 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:42.422669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lazy-loading 'fault' on Instance uuid 30d717b2-d743-407d-99fe-5f95c562d737 {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:53:42.488823 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0824d8df380e477b85690814b0a2a9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55704b6435104c8e958ae6c5bb202f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:53:42.498115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ce396b01-f21c-4cc0-8847-e2d869fac89c tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 200 len: 1308 microversion: 2.1 time: 0.173845 Jun 16 17:53:42.498857 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 523/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:42 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:53:43.517045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:53:43.517760 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] [instance: 30d717b2-d743-407d-99fe-5f95c562d737] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:53:43.520770 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:43.527915 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:43.528983 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:43.531047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:53:43.531047 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:53:43.549237 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] HTTP exception thrown: Instance 30d717b2-d743-407d-99fe-5f95c562d737 could not be found. Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Request method failure captured: Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 HTTP/1.1 Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq22Ryt86qopYxEznL3aAVJ7j9eVSIqK7a8OPlReqaerHNoSyT-40qGWjdLXHmAAWYKzXgZJ7qjs1yeNvpkD0kGjo_hHd5LHpuEubK-9JgRbSOqiaBRIADO5IMo8zCfmIIayPsU_lkPCAgPwWOpafWEpmytPtb-hA4RmUWWadC3-oM1I Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 55704b6435104c8e958ae6c5bb202f24 Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-VolumesSnapshotTestJSON-671345733 Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:53:43.551192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55704b6435104c8e958ae6c5bb202f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55704b6435104c8e958ae6c5bb202f24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55704b6435104c8e958ae6c5bb202f24", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55704b6435104c8e958ae6c5bb202f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-VolumesSnapshotTestJSON-671345733 Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 55704b6435104c8e958ae6c5bb202f24 Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-671345733 Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-VolumesSnapshotTestJSON-671345733-project Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 0824d8df380e477b85690814b0a2a9e3 Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-VolumesSnapshotTestJSON-671345733-project Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 30d717b2-d743-407d-99fe-5f95c562d737 could not be found. Jun 16 17:53:43.552958 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '30d717b2-d743-407d-99fe-5f95c562d737'} Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d717b2-d743-407d-99fe-5f95c562d737 could not be found. Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:53:43.554441 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d717b2-d743-407d-99fe-5f95c562d737 could not be found. Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d717b2-d743-407d-99fe-5f95c562d737 could not be found. Jun 16 17:53:43.555999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:53:43.557457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] Returning 404 to user: Instance 30d717b2-d743-407d-99fe-5f95c562d737 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:53:43.557457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-ed53d520-e281-47e3-9115-d29baef459d1 tempest-VolumesSnapshotTestJSON-671345733 tempest-VolumesSnapshotTestJSON-671345733-project] 10.222.0.42 "GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737" status: 404 len: 111 microversion: 2.1 time: 0.040332 Jun 16 17:53:43.557457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 534/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:53:43 2022] GET /compute/v2.1/servers/30d717b2-d743-407d-99fe-5f95c562d737 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:53:48.527246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-dfb17b61-8753-4a6e-8d92-bd74986bc739 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Action: 'create', calling method: .version_select at 0x7f287ffaef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-2124786351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdeJYbaDrm3TvWvti6PgRsEJ/ck1UprA/3Avv4q3PJiRQhNh3H/7eVV8f5CeFTuBgbbYEYnbzmOlxnJiTuobufG7VH0a67xVzxNPqiKy31CGBbTu3GivbvnudfGqDsQ8Q=="}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:53:48.532427 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=32 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:48.549385 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-dfb17b61-8753-4a6e-8d92-bd74986bc739 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Getting quotas for project 10fb3764f6df42a7835b8458847cad0a. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:53:48.554102 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-dfb17b61-8753-4a6e-8d92-bd74986bc739 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Getting quotas for user 183c052ce8ea4899bf2c07bf63f67fd3 and project 10fb3764f6df42a7835b8458847cad0a. Resources: {'key_pairs'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:53:48.577804 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-dfb17b61-8753-4a6e-8d92-bd74986bc739 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242609 Jun 16 17:53:48.578681 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 524/1058] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jun 16 17:53:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:54:01.060914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:54:01.061474 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Thu Jun 16 17:54:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:54:08.029904 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1063567816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2124786351", "security_groups": [{"name": "tempest-secgroup-smoke-2095036569"}], "networks": [{"uuid": "4d7c5033-9722-4074-8dfe-acb33ca92e06"}], "block_device_mapping_v2": [{"uuid": "06b19eaf-1893-44ff-b1f6-5232be46075f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:54:08.039491 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:08.040130 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:08.365281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.network.neutron [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] validate_networks() for [('4d7c5033-9722-4074-8dfe-acb33ca92e06', None, None, None, None, None)] {{(pid=124157) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:54:08.733563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Flavor limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:54:08.733994 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Image limits 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:54:08.734472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Flavor pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:54:08.734884 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Image pref 0:0:0 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:54:08.735298 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.virt.hardware [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:54:08.744894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:08.745341 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:08.746144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:08.746586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:08.763299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Getting quotas for project 10fb3764f6df42a7835b8458847cad0a. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:54:08.767312 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.quota [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Getting quotas for user 183c052ce8ea4899bf2c07bf63f67fd3 and project 10fb3764f6df42a7835b8458847cad0a. Resources: {'cores', 'instances', 'ram'} {{(pid=124157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:54:08.823985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Going to run 1 instances... {{(pid=124157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:54:08.826198 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06b19eaf-1893-44ff-b1f6-5232be46075f',volume_size=None,volume_type=None)] {{(pid=124157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:54:08.953298 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4dcb81e0-a261-40de-a148-df09e6b5ee53 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.927396 Jun 16 17:54:08.953949 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 535/1059] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:54:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:54:08.965127 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7a1395bd-0435-4880-9ee7-735b5216c8a4 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:08.965898 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7a1395bd-0435-4880-9ee7-735b5216c8a4 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:08.967824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=83 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:08.969136 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=4 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:08.969832 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:09.142838 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7a1395bd-0435-4880-9ee7-735b5216c8a4 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:09.151101 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7a1395bd-0435-4880-9ee7-735b5216c8a4 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1089 microversion: 2.1 time: 0.191003 Jun 16 17:54:09.151676 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 525/1060] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:08 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1089 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:10.168796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:10.169417 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:10.175660 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:10.176114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:10.176911 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:10.177349 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:10.248538 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:10.258686 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-0453f1f1-5902-45d0-8c52-bd343e560908 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1205 microversion: 2.1 time: 0.093946 Jun 16 17:54:10.259456 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 536/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:10 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:11.276329 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:11.277758 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:11.286120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:11.286901 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:11.287891 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:11.288340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:11.519920 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:11.533398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-21b75e25-56bf-4930-8f99-70de400f5fe8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.260872 Jun 16 17:54:11.534546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 526/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:11 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:11.570205 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-05b1ac04-f398-42fc-8c78-bde6c0c0c412 req-80db7225-b3ee-47ea-9a64-8c03addf6c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:54:11.598538 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-05b1ac04-f398-42fc-8c78-bde6c0c0c412 req-80db7225-b3ee-47ea-9a64-8c03addf6c91 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:11.598990 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-05b1ac04-f398-42fc-8c78-bde6c0c0c412 req-80db7225-b3ee-47ea-9a64-8c03addf6c91 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:11.611600 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-05b1ac04-f398-42fc-8c78-bde6c0c0c412 req-80db7225-b3ee-47ea-9a64-8c03addf6c91 service nova] Creating event network-changed:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:54:11.616938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-05b1ac04-f398-42fc-8c78-bde6c0c0c412 req-80db7225-b3ee-47ea-9a64-8c03addf6c91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050928 Jun 16 17:54:11.618096 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 537/1063] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:54:12.552624 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:12.553246 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:12.560617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:12.561090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:12.561875 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:12.562321 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:12.775283 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:12.782775 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fc3c2802-b1e9-4453-a934-1052551b4cd8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.234116 Jun 16 17:54:12.783338 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 527/1064] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:12 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:13.799889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:13.800631 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:13.808056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:13.808535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:13.809311 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:13.809752 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:13.946192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:13.953720 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b1cb2629-cf9f-4e60-a188-1e6d1d56251b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.158165 Jun 16 17:54:13.954284 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 538/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:13 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:14.971281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:14.971902 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:14.979236 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:14.979697 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:14.980505 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:14.980942 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:15.115109 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:15.122569 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-befa51a9-8d46-4471-94ce-824babe639e2 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.155255 Jun 16 17:54:15.123142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 528/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:14 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:16.139587 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:16.140129 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:16.146580 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:16.147026 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:16.147784 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:16.148242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:16.288049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:16.296134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-44c4cf8f-a478-47c7-8fd5-5fc869a01a9b tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.160768 Jun 16 17:54:16.296736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 539/1067] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:16 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:17.312947 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:17.313556 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:17.320014 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:17.321115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:17.321984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:17.322427 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:17.453341 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:17.461135 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f8d62af3-dff4-4058-8288-ce76c5e1c080 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.151954 Jun 16 17:54:17.461782 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 529/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:17 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:18.479734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:18.480817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:18.487486 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:18.488122 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:18.488926 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:18.489362 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:18.622401 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:18.629897 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-16f1a106-0a6c-4533-ab6b-cd3fa08fc584 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.154247 Jun 16 17:54:18.630449 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 540/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:18 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:19.646971 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:19.647579 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:19.649900 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:19.655633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:19.656112 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:19.656933 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:19.657373 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:19.790750 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:19.798458 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-f8cff04a-1e13-488a-bcbe-b1c48a40bd17 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.155301 Jun 16 17:54:19.799028 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 530/1070] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:19 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:20.816447 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:20.817185 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:20.819419 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:20.820892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=6 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:20.828169 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:20.828830 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:20.831938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:20.831938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:20.966170 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:20.973731 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a2255103-4f4a-4327-b7d6-1dec0417f8c9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.162096 Jun 16 17:54:20.974301 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 541/1071] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:20 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:21.990951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:21.991501 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:21.998319 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:21.998776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:21.999549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:22.000017 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:22.133795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:22.141527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-47f8a446-98d9-4970-b76a-2b83b6105d9d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.154559 Jun 16 17:54:22.142092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 531/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:21 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:22.881212 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-7230adc2-d191-4250-b962-5351e8a2ad9a req-1a470512-dd6f-45c4-ad77-b7d4528b1fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "name": "network-vif-plugged", "status": "completed", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:54:22.891166 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-7230adc2-d191-4250-b962-5351e8a2ad9a req-1a470512-dd6f-45c4-ad77-b7d4528b1fd0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:22.891615 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-7230adc2-d191-4250-b962-5351e8a2ad9a req-1a470512-dd6f-45c4-ad77-b7d4528b1fd0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:22.903900 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-7230adc2-d191-4250-b962-5351e8a2ad9a req-1a470512-dd6f-45c4-ad77-b7d4528b1fd0 service nova] Creating event network-vif-plugged:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:54:22.908869 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-7230adc2-d191-4250-b962-5351e8a2ad9a req-1a470512-dd6f-45c4-ad77-b7d4528b1fd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031409 Jun 16 17:54:22.909461 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 542/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:54:23.159097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:23.159647 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:23.166718 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:23.167174 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:23.167956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:23.168413 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:23.319025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:23.327200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ba101125-4248-4a17-99b3-2dc37e62499f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.172086 Jun 16 17:54:23.327755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 532/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:23 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:24.344045 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:24.344783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:24.351051 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:24.352112 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:24.353055 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:24.353500 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:24.484883 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:24.493601 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-cb4908a8-ad60-4eec-8046-2ddca8f53987 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1261 microversion: 2.1 time: 0.154204 Jun 16 17:54:24.494169 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 543/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:24 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:25.510849 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:25.511468 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:25.518800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:25.519256 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:25.520036 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:25.520512 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:25.654117 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:25.661799 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-41286047-b224-4911-aab7-68c9e2a815bb tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1445 microversion: 2.1 time: 0.155391 Jun 16 17:54:25.662369 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 533/1076] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:25 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:25.678340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:54:25.678963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:54:25.686405 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:25.686853 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:25.687614 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:25.688048 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:25.819440 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:54:25.827052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2798e47b-36f1-4078-ac5d-10035cc881ba tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1445 microversion: 2.1 time: 0.152621 Jun 16 17:54:25.827618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 544/1077] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:54:25 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:54:27.771802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-26800b04-1779-434e-92ea-0e0a62a73935 req-d1a3d66a-8dfe-430c-930a-2fa07a015e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:54:27.781401 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-26800b04-1779-434e-92ea-0e0a62a73935 req-d1a3d66a-8dfe-430c-930a-2fa07a015e44 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:54:27.781855 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-26800b04-1779-434e-92ea-0e0a62a73935 req-d1a3d66a-8dfe-430c-930a-2fa07a015e44 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:54:27.793584 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-26800b04-1779-434e-92ea-0e0a62a73935 req-d1a3d66a-8dfe-430c-930a-2fa07a015e44 service nova] Creating event network-changed:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:54:27.798639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-26800b04-1779-434e-92ea-0e0a62a73935 req-d1a3d66a-8dfe-430c-930a-2fa07a015e44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030489 Jun 16 17:54:27.799241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 534/1078] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:55:45.577151 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:45.577894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=48 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:45.581849 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:45.582340 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:45.589863 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:45.590332 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:45.591085 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:45.591518 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:45.618248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:55:45.693031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bf00be3a-8faf-4720-948a-046edc6267ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "DELETE /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 204 len: 0 microversion: 2.1 time: 0.117419 Jun 16 17:55:45.693620 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 545/1079] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:55:45 2022] DELETE /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:55:45.701043 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=22 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:45.702084 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=50 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:45.706535 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:45.707266 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:45.714253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:45.714706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:45.715479 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:45.715925 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:45.847836 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:45.856072 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ce17a294-5bc1-4cf6-adad-a9bf4a12151b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1578 microversion: 2.1 time: 0.157255 Jun 16 17:55:45.856673 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 535/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:45 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:46.874406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:46.875113 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:46.881762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:46.882223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:46.883467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:46.883912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:47.025385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:47.032926 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-11bda9dc-1a28-43b7-b72f-e3d22ee7de32 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1578 microversion: 2.1 time: 0.162807 Jun 16 17:55:47.033500 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 546/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:46 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:48.050946 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:48.051510 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:48.065922 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:48.066436 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:48.067469 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:48.068110 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:48.290776 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:48.298525 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-e2c3e36e-815a-47e6-a98e-70d8ef189c55 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1578 microversion: 2.1 time: 0.251598 Jun 16 17:55:48.299100 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 536/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:48 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1578 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:48.745365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-7e32021c-341b-4205-9464-443c6cd5d120 req-c54ee119-092f-47ed-953a-75bfabeb5ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955d0309-09c6-4b7b-9238-c3fc7f72480f", "name": "network-vif-deleted", "tag": "22e5764f-e79f-44af-878a-3414fd999055"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:55:48.759754 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-7e32021c-341b-4205-9464-443c6cd5d120 req-c54ee119-092f-47ed-953a-75bfabeb5ac0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:48.760434 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-7e32021c-341b-4205-9464-443c6cd5d120 req-c54ee119-092f-47ed-953a-75bfabeb5ac0 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:48.776013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-7e32021c-341b-4205-9464-443c6cd5d120 req-c54ee119-092f-47ed-953a-75bfabeb5ac0 service nova] Creating event network-vif-deleted:22e5764f-e79f-44af-878a-3414fd999055 for instance 955d0309-09c6-4b7b-9238-c3fc7f72480f on hv-cinder-83754 Jun 16 17:55:48.781797 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-7e32021c-341b-4205-9464-443c6cd5d120 req-c54ee119-092f-47ed-953a-75bfabeb5ac0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109416 Jun 16 17:55:48.782558 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 547/1083] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:55:49.315537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:49.316175 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:49.322863 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:49.323309 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:49.324080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:49.324549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:49.355748 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:49.356200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:49.356671 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lazy-loading 'fault' on Instance uuid 955d0309-09c6-4b7b-9238-c3fc7f72480f {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:55:49.401514 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:49.408983 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-fb00284b-ded2-41c4-ab40-1aecc9cc3a78 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 200 len: 1230 microversion: 2.1 time: 0.097414 Jun 16 17:55:49.409549 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 537/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:49 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:50.342859 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:55:50.343537 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Thu Jun 16 17:55:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:55:50.427750 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:50.428470 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:50.435714 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:50.436163 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:50.436963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:50.437395 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:50.451610 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] HTTP exception thrown: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Request method failure captured: Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f HTTP/1.1 Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq23BtWow5MW9gk4e-J6QHlvoQNTcCcoZn9YtTRPrcOiRgcbbWOYxoAa8pr0iMQ5Y6LUpc7s8Amf03jmFE28iZt--DBHK0sLMyd6PXB0QtlrUHwjyqiUwKxXo4Q56IbrvyZBl-cQL5MEYpMnbw8HxGLzQQQJ6MvfsOOuEc-UrGM1Oqz4 Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:55:50.453196 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c249c315494483892639b1213d4bc5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c249c315494483892639b1213d4bc5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-TestVolumeBootPattern-276852507 Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 31e04db1b0f6444e9a884a0e58ba38da Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:55:50.454956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '955d0309-09c6-4b7b-9238-c3fc7f72480f'} Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:55:50.456123 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:55:50.458022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:55:50.459487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Returning 404 to user: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:55:50.459487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dbd05cb6-1756-42b4-ab31-5c8613049be7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 404 len: 111 microversion: 2.1 time: 0.031614 Jun 16 17:55:50.459487 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 548/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:50 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:55:50.549392 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-260933244", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-988845154", "security_groups": [{"name": "tempest-secgroup-smoke-1490933338"}], "block_device_mapping_v2": [{"uuid": "fbb1e23b-0275-4200-a0d6-328502a63c85", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f9a2faf-961d-4809-b337-0b0a1287acd0"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:55:50.660436 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] validate_networks() for [('6f9a2faf-961d-4809-b337-0b0a1287acd0', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:55:51.041098 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:55:51.041533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:55:51.042018 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:55:51.042532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:55:51.042956 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:55:51.051713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:51.052170 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:51.053010 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:51.053459 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:51.076719 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for project 9c249c315494483892639b1213d4bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:55:51.082454 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for user 31e04db1b0f6444e9a884a0e58ba38da and project 9c249c315494483892639b1213d4bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:55:51.158951 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:55:51.161058 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbb1e23b-0275-4200-a0d6-328502a63c85',volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:55:51.292437 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-843a1cd5-6bcc-4c69-95f1-37f3df3cf68f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746732 Jun 16 17:55:51.292997 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 538/1086] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:55:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:55:51.302970 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b8e3a6de-d3d6-467b-b091-771fbe5004ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:51.303623 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b8e3a6de-d3d6-467b-b091-771fbe5004ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:51.360198 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b8e3a6de-d3d6-467b-b091-771fbe5004ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:51.367817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b8e3a6de-d3d6-467b-b091-771fbe5004ba tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1093 microversion: 2.1 time: 0.067924 Jun 16 17:55:51.368400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 549/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:51 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:52.386710 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-24ec1ada-aafc-4cfd-b63d-0d5999fda1e5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:52.387324 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-24ec1ada-aafc-4cfd-b63d-0d5999fda1e5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:52.438652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-24ec1ada-aafc-4cfd-b63d-0d5999fda1e5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:52.445871 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-24ec1ada-aafc-4cfd-b63d-0d5999fda1e5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1093 microversion: 2.1 time: 0.063410 Jun 16 17:55:52.446626 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 539/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:52 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:53.462233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:53.462860 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:53.469728 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:53.470191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:53.470964 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:53.471416 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:53.536472 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:53.544406 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-625b3ca2-829e-4627-a821-f298fa1f864f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1143 microversion: 2.1 time: 0.086307 Jun 16 17:55:53.544961 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 550/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:53 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:54.561912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:54.562631 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:54.569723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:54.570911 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:54.571683 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:54.572116 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:54.647916 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:54.655787 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-ea14d5f5-df7a-48f4-b198-d629d1bbf717 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1209 microversion: 2.1 time: 0.097798 Jun 16 17:55:54.656365 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 540/1090] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:54 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:55.675095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:55.676450 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:55.686056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:55.686546 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:55.687425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:55.688056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:55.893466 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:55.901177 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-9f7d5e1f-c132-4575-b662-8a5c8da1a101 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.231420 Jun 16 17:55:55.901756 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 551/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:55 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:55.972108 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-e412677a-a19a-48e3-927d-dc47126ef316 req-43b2de7b-8b94-4748-b86b-8bf549daf11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16893cb6-ef92-4114-84fb-7cf28b2b85eb", "tag": "2daf38d7-2d75-4fba-bb85-895f29b7ed35"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:55:55.982882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e412677a-a19a-48e3-927d-dc47126ef316 req-43b2de7b-8b94-4748-b86b-8bf549daf11a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:55.983716 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-e412677a-a19a-48e3-927d-dc47126ef316 req-43b2de7b-8b94-4748-b86b-8bf549daf11a service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:56.007860 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-e412677a-a19a-48e3-927d-dc47126ef316 req-43b2de7b-8b94-4748-b86b-8bf549daf11a service nova] Creating event network-changed:2daf38d7-2d75-4fba-bb85-895f29b7ed35 for instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb on hv-cinder-83754 Jun 16 17:55:56.013498 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-e412677a-a19a-48e3-927d-dc47126ef316 req-43b2de7b-8b94-4748-b86b-8bf549daf11a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045208 Jun 16 17:55:56.014225 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 541/1092] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:55:56.918544 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:56.919191 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:56.925778 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:56.926178 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:56.926950 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:56.927393 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:57.177828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:57.185510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-73ac2849-1535-4aa3-aad8-9866f9fd0036 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.270937 Jun 16 17:55:57.186092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 552/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:56 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:58.203279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:58.203997 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:58.210263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:58.211263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:58.212039 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:58.212524 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:58.350115 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:58.358555 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2e782de4-30bc-4f2d-b7c0-5754284fa953 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.159937 Jun 16 17:55:58.359128 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 542/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:58 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:55:59.375168 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:55:59.375815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:55:59.382273 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:59.382736 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:59.383514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:55:59.384000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:55:59.520078 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:55:59.528655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-07dc28b9-6e79-4223-9f35-2e4631fd8deb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.157515 Jun 16 17:55:59.529219 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 553/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:55:59 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:00.547348 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:00.548144 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:00.554800 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:00.555257 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:00.556068 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:00.556554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:00.689062 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:00.697104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bc6d7366-d988-45c5-87b9-5981ac32bf5f tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.154791 Jun 16 17:56:00.697699 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 543/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:00 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:01.714363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:01.714914 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:01.717320 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:01.722829 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:01.723274 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:01.724117 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:01.724589 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:01.855618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:01.863052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c4d83062-54dd-4502-97ab-4871abb942bc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.153302 Jun 16 17:56:01.863618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 554/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:01 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:02.880639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:02.881262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:02.884015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:02.885203 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=8 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:02.891546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:02.892041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:02.892953 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:02.893398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:03.032120 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:03.040234 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-698f49f9-8c63-4d13-a3b4-21bed801d2c8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.163553 Jun 16 17:56:03.040822 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 544/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:02 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:56:04.058022 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:04.058671 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:04.065234 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:04.065694 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:04.066467 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:04.066912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:04.197200 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:04.204633 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-074fc3ad-0c76-4861-9143-5fc53dd80fef tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.151445 Jun 16 17:56:04.205197 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 555/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:04 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:05.221828 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:05.222433 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:05.230186 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:05.230652 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:05.231429 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:05.232031 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:05.365180 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:05.373219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-c7ea89ee-5719-4ad8-9011-c0a4599a0030 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.155185 Jun 16 17:56:05.373926 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 545/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:05 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:06.391328 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:06.391956 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:06.399152 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:06.399607 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:06.400425 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:06.400875 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:06.536665 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:06.544668 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-655b2d5c-0c49-4885-b112-cfb4da1b8ecc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.157426 Jun 16 17:56:06.545235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 556/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:06 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:07.519550 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-1b85f71b-8feb-4804-9e05-fe5744985357 req-c28f8007-6de1-45cf-a071-8bd37cc45317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16893cb6-ef92-4114-84fb-7cf28b2b85eb", "name": "network-vif-plugged", "status": "completed", "tag": "2daf38d7-2d75-4fba-bb85-895f29b7ed35"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:56:07.528099 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1b85f71b-8feb-4804-9e05-fe5744985357 req-c28f8007-6de1-45cf-a071-8bd37cc45317 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:07.528577 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-1b85f71b-8feb-4804-9e05-fe5744985357 req-c28f8007-6de1-45cf-a071-8bd37cc45317 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:07.540166 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-1b85f71b-8feb-4804-9e05-fe5744985357 req-c28f8007-6de1-45cf-a071-8bd37cc45317 service nova] Creating event network-vif-plugged:2daf38d7-2d75-4fba-bb85-895f29b7ed35 for instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb on hv-cinder-83754 Jun 16 17:56:07.545187 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-1b85f71b-8feb-4804-9e05-fe5744985357 req-c28f8007-6de1-45cf-a071-8bd37cc45317 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144731 Jun 16 17:56:07.545757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 546/1102] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:56:07.562743 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:07.563366 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:07.570076 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:07.570534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:07.571305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:07.571751 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:07.708773 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:07.717799 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2fa46bff-d324-43a9-ad02-caa11df01ce1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.158662 Jun 16 17:56:07.718582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 557/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:07 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:08.736015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:08.736762 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:08.743461 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:08.743905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:08.744700 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:08.745139 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:08.876704 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:08.885669 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-19f7d206-e673-41e9-b0f6-ebc7ab6f1962 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1265 microversion: 2.1 time: 0.154093 Jun 16 17:56:08.886305 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 547/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:08 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:09.903080 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:09.903693 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:09.910287 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:09.910738 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:09.911498 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:09.911945 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:10.048215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:10.056345 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-a58468b8-76c1-49fe-9154-cdd195658026 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1451 microversion: 2.1 time: 0.157118 Jun 16 17:56:10.056931 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 558/1105] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:09 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:10.072815 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:10.073449 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:10.079943 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:10.080422 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:10.081191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:10.081632 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:10.216359 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:10.223804 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-97ea5d14-8bb8-4ef1-8799-b107ff120c68 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1451 microversion: 2.1 time: 0.155363 Jun 16 17:56:10.224465 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 548/1106] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:10 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:11.780017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-1078ef60-95db-4097-bffe-2ea2ddd047d4 req-616799eb-e202-4256-87a6-8ad71cfad006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16893cb6-ef92-4114-84fb-7cf28b2b85eb", "tag": "2daf38d7-2d75-4fba-bb85-895f29b7ed35"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:56:11.790060 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1078ef60-95db-4097-bffe-2ea2ddd047d4 req-616799eb-e202-4256-87a6-8ad71cfad006 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:11.790783 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-1078ef60-95db-4097-bffe-2ea2ddd047d4 req-616799eb-e202-4256-87a6-8ad71cfad006 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:11.802031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-1078ef60-95db-4097-bffe-2ea2ddd047d4 req-616799eb-e202-4256-87a6-8ad71cfad006 service nova] Creating event network-changed:2daf38d7-2d75-4fba-bb85-895f29b7ed35 for instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb on hv-cinder-83754 Jun 16 17:56:11.807737 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-1078ef60-95db-4097-bffe-2ea2ddd047d4 req-616799eb-e202-4256-87a6-8ad71cfad006 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031511 Jun 16 17:56:11.808329 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 559/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:56:25.437643 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:56:25.438253 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:25.440808 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:25.441801 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=68 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:25.448650 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:25.449119 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:25.449905 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:25.450350 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:25.473386 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.objects.instance [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lazy-loading 'flavor' on Instance uuid 1d2d3671-1fae-4515-8c16-9c99405e7ff1 {{(pid=124158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:56:25.548276 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-359cd4d1-5dfb-4bac-9594-b6d72d15ce19 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "POST /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.114293 Jun 16 17:56:25.548906 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 549/1108] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:56:25 2022] POST /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:56:25.555087 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:25.555842 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:56:25.560579 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:25.561299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:25.569049 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:25.569489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:25.570272 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:25.570749 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:25.714382 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:25.721921 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-444ed847-4818-4741-9702-b6723fd469d7 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.168429 Jun 16 17:56:25.722492 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 560/1109] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:25 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:26.741691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:26.742401 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:26.748714 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:26.749171 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:26.749946 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:26.750389 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:26.880554 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:26.888523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2716365a-1775-47d7-a90b-5ebcc86d2a3d tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.151548 Jun 16 17:56:26.889085 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 550/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:26 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:27.906091 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:27.906707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:27.913255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:27.913707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:27.914469 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:27.914908 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:28.043632 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:28.051125 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-2f6af0be-c01a-4f69-aadc-743b8facfbc1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.148927 Jun 16 17:56:28.051695 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 561/1111] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:27 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:29.068634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:29.069259 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:29.076532 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:29.076991 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:29.077840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:29.078286 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:29.218513 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:29.226290 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2529973d-0734-46f4-8c3d-255cabcdc1b1 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.161655 Jun 16 17:56:29.226861 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 551/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:29 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:30.243612 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:30.244260 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:30.251508 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:30.251962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:30.252817 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:30.253256 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:30.380947 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:30.388797 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-edd5f284-76c8-44f3-b83f-21d7440a4a1f tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.148974 Jun 16 17:56:30.389374 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 562/1113] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:30 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:31.406041 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:31.406664 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:31.413312 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:31.413773 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:31.414553 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:31.414997 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:31.809256 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:31.816802 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-24af7692-933a-49d3-9d37-471308f25ff8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.414726 Jun 16 17:56:31.817362 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 552/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:31 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:32.834514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:32.835114 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:32.842126 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:32.842586 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:32.843363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:32.843812 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:32.977263 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:32.985299 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-eeebb9a3-c53c-4bf7-9472-767a39d432b8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.154691 Jun 16 17:56:32.985866 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 563/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:32 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:34.002104 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:34.002755 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:34.009310 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:34.009767 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:34.011080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:34.011610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:34.146482 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:34.154590 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-77a91908-6791-466c-b4c0-13df4bf4b350 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.156337 Jun 16 17:56:34.155156 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 553/1116] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:33 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:35.171815 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:35.172453 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:35.178889 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:35.179333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:35.180082 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:35.180559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:35.310663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:35.318192 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-c4b24522-f695-45fb-a297-0da960b582ae tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.150336 Jun 16 17:56:35.318762 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 564/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:35 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:35.659912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:56:35.660480 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Thu Jun 16 17:56:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:56:36.335177 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:36.335795 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:36.342957 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:36.343411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:36.344218 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:36.344691 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:36.480522 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:36.488767 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7c34c492-c2c0-41fa-9599-b1b057288ef8 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.157512 Jun 16 17:56:36.489335 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 554/1118] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:36 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:37.505916 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:37.506538 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:37.514068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:37.514524 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:37.515297 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:37.515741 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:37.657893 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:37.665514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7f95bd7e-ba12-4d4b-adcd-4dd4a8d6bd97 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.163492 Jun 16 17:56:37.666627 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 565/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:37 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:38.683642 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:38.684410 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:38.691037 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:38.691486 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:38.692254 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:38.692713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:38.821869 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:38.829583 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-7212b6c3-14ef-4c09-9ab7-8e8bb6b9cbb9 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1571 microversion: 2.1 time: 0.150402 Jun 16 17:56:38.830136 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 555/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:38 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:56:38.846400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:56:38.846973 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:38.853554 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:38.854596 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:38.855563 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:38.856007 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:38.932147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-dcad984b-0a0a-4374-8dee-0a8c701747ef tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "POST /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.089484 Jun 16 17:56:38.933060 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 566/1121] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jun 16 17:56:38 2022] POST /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:56:38.941372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:38.942004 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:38.948294 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:38.948820 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:38.949592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:38.950030 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:39.120805 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:39.128960 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a7753aa0-aad6-4b0e-b053-e00d52861d32 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1579 microversion: 2.1 time: 0.191461 Jun 16 17:56:39.129544 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 556/1122] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:38 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1579 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:56:40.148767 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:40.149291 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:40.156312 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:40.156798 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:40.157559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:40.158000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:40.308335 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:40.316688 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-27feff47-d289-4820-b645-3dfc08320463 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1521 microversion: 2.1 time: 0.172482 Jun 16 17:56:40.317333 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 567/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:40 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:41.334609 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:41.335216 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:41.342387 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:41.342840 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:41.343606 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:41.344040 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:41.473636 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:41.481858 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2f006726-9cea-428d-b4a0-6008c34723de tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.151166 Jun 16 17:56:41.482533 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 557/1124] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:41 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:41.510826 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-3ee83224-5099-41f3-8890-28503d018215 req-9a18007a-8d1b-4c03-8ad9-0a59ae77be08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "name": "network-vif-unplugged", "status": "completed", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:56:41.521975 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3ee83224-5099-41f3-8890-28503d018215 req-9a18007a-8d1b-4c03-8ad9-0a59ae77be08 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:41.522510 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3ee83224-5099-41f3-8890-28503d018215 req-9a18007a-8d1b-4c03-8ad9-0a59ae77be08 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:41.533803 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-3ee83224-5099-41f3-8890-28503d018215 req-9a18007a-8d1b-4c03-8ad9-0a59ae77be08 service nova] Creating event network-vif-unplugged:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:56:41.539372 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-3ee83224-5099-41f3-8890-28503d018215 req-9a18007a-8d1b-4c03-8ad9-0a59ae77be08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037737 Jun 16 17:56:41.540062 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 568/1125] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:56:42.499557 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:42.500176 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:42.506730 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:42.507192 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:42.507968 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:42.508451 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:42.638819 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:42.646301 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-5e0c3f6b-ba54-4060-a7e8-e4fcee508126 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.150639 Jun 16 17:56:42.646873 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 558/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:42 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:43.665235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:43.665936 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:43.672281 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:43.672771 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:43.673535 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:43.673977 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:43.812963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:43.820568 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-1b2cc920-5e6d-485b-ac59-f6990bf6bf78 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.160055 Jun 16 17:56:43.821140 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 569/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:43 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:44.838080 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:44.838763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:44.845339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:44.845793 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:44.846568 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:44.847015 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:44.975948 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:44.984114 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-baae5011-87dc-4201-887a-1d0b0b323b29 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.149967 Jun 16 17:56:44.984727 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 559/1128] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:44 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:46.000924 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:46.001547 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:46.008097 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:46.008588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:46.009365 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:46.009807 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:46.140802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:46.148350 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4560d62e-faf9-4478-89f9-5e790909ae46 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.151314 Jun 16 17:56:46.148938 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 570/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:45 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:47.166941 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:47.168226 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:47.175361 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:47.175816 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:47.176698 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:47.177256 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:47.337432 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:47.348305 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4973286a-b432-454c-a3ce-8657e3531b60 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.185951 Jun 16 17:56:47.348904 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 560/1130] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:47 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:48.365254 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:48.365880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:48.373172 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:48.373630 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:48.374400 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:48.374846 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:48.509046 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:48.517304 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-557e4956-7d45-4a1a-8fa0-a77d960eaa90 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1577 microversion: 2.1 time: 0.155951 Jun 16 17:56:48.517880 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 571/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:48 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:49.535579 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:56:49.536195 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:56:49.543183 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:49.543634 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:49.544592 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:49.544984 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:49.680809 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:56:49.688398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-04c37598-162d-4dc6-ae2d-ed373f45f154 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1564 microversion: 2.1 time: 0.156662 Jun 16 17:56:49.688965 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 561/1132] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:56:49 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:56:51.565271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-fe867cc3-e703-44b2-a992-1368fa4e3c3c req-56e32fba-52c7-4f90-9480-e285bd82b42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "name": "network-vif-plugged", "status": "completed", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:56:51.574175 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-fe867cc3-e703-44b2-a992-1368fa4e3c3c req-56e32fba-52c7-4f90-9480-e285bd82b42d service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:56:51.574656 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-fe867cc3-e703-44b2-a992-1368fa4e3c3c req-56e32fba-52c7-4f90-9480-e285bd82b42d service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:56:51.587669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-fe867cc3-e703-44b2-a992-1368fa4e3c3c req-56e32fba-52c7-4f90-9480-e285bd82b42d service nova] Creating event network-vif-plugged:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:56:51.593215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-fe867cc3-e703-44b2-a992-1368fa4e3c3c req-56e32fba-52c7-4f90-9480-e285bd82b42d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Jun 16 17:56:51.593984 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 572/1133] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:57:21.069919 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:57:21.070645 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Thu Jun 16 17:57:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:57:48.185664 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-987558683", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-988845154", "security_groups": [{"name": "tempest-secgroup-smoke-1490933338"}], "block_device_mapping_v2": [{"uuid": "7c528ab2-af39-45d7-a21d-ca7a8b9b86ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f9a2faf-961d-4809-b337-0b0a1287acd0"}]}} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:57:48.194057 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=26 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:57:48.194872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:57:48.304024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.network.neutron [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] validate_networks() for [('6f9a2faf-961d-4809-b337-0b0a1287acd0', None, None, None, None, None)] {{(pid=124158) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:57:48.730548 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Flavor limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:57:48.732083 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Image limits 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:57:48.732617 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Flavor pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:57:48.733038 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Image pref 0:0:0 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:57:48.733467 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.virt.hardware [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:57:48.742287 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:48.742742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:48.743546 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:48.743985 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:48.761874 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for project 9c249c315494483892639b1213d4bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:57:48.767017 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.quota [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Getting quotas for user 31e04db1b0f6444e9a884a0e58ba38da and project 9c249c315494483892639b1213d4bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:57:48.823919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Going to run 1 instances... {{(pid=124158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:57:48.826757 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c528ab2-af39-45d7-a21d-ca7a8b9b86ba',volume_size=None,volume_type=None)] {{(pid=124158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:57:48.961705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-4588a91e-2c6a-4ef9-9fc4-a3509d98adc8 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780533 Jun 16 17:57:48.962349 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 562/1134] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jun 16 17:57:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:57:48.974071 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-7e2d2519-3880-425c-8240-7b11f125d452 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:48.974652 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-7e2d2519-3880-425c-8240-7b11f125d452 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:48.980460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=28 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:57:48.981697 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:57:49.041151 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-7e2d2519-3880-425c-8240-7b11f125d452 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:49.048344 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-7e2d2519-3880-425c-8240-7b11f125d452 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1093 microversion: 2.1 time: 0.079092 Jun 16 17:57:49.048963 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 573/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:48 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:50.065998 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:50.066545 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:50.073354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:50.073811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:50.074633 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:50.075092 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:50.135811 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:50.143742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-34765b85-b989-43e9-98af-a28912723965 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1191 microversion: 2.1 time: 0.082324 Jun 16 17:57:50.144308 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 563/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:50 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:51.161903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:51.162536 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:51.170542 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:51.171135 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:51.172341 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:51.173056 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:51.410490 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:51.418053 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5c46a67c-68c1-4e85-80e5-f7c18acf493b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1277 microversion: 2.1 time: 0.260456 Jun 16 17:57:51.419489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 574/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:51 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:51.962790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-f288390f-5ce8-4e0e-ad12-59bd3e669786 req-c0d515b7-63b1-46a3-9e51-7f166d741a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1573da16-9702-4c0d-a469-9530d24afe03", "tag": "37ebbb22-a951-4d8e-a79b-6f226383b18b"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:57:51.972500 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-f288390f-5ce8-4e0e-ad12-59bd3e669786 req-c0d515b7-63b1-46a3-9e51-7f166d741a97 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:51.973086 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-f288390f-5ce8-4e0e-ad12-59bd3e669786 req-c0d515b7-63b1-46a3-9e51-7f166d741a97 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:51.990266 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-f288390f-5ce8-4e0e-ad12-59bd3e669786 req-c0d515b7-63b1-46a3-9e51-7f166d741a97 service nova] Creating event network-changed:37ebbb22-a951-4d8e-a79b-6f226383b18b for instance 1573da16-9702-4c0d-a469-9530d24afe03 on hv-cinder-83754 Jun 16 17:57:51.995708 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-f288390f-5ce8-4e0e-ad12-59bd3e669786 req-c0d515b7-63b1-46a3-9e51-7f166d741a97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036542 Jun 16 17:57:51.997205 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 564/1138] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:57:52.435827 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:52.436363 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:52.442582 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:52.443020 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:52.443912 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:52.444346 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:52.578628 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:52.586141 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-14836bd7-3a3b-4362-a2ff-acc5620c2e94 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.154778 Jun 16 17:57:52.586707 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 575/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:52 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:53.604135 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:53.605417 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:53.612599 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:53.613264 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:53.614034 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:53.614468 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:53.754265 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:53.761763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-3696c3da-752c-4056-8106-d9f5dbbe55d1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.162333 Jun 16 17:57:53.763219 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 565/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:53 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:54.779248 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:54.779802 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:54.786403 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:54.786901 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:54.787676 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:54.788113 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:54.920988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:54.928399 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-da1f01bd-53b5-46ff-973e-d9b212e26be5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.153798 Jun 16 17:57:54.928972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 576/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:54 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:55.945398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:55.946022 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:55.952222 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:55.952705 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:55.953481 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:55.953923 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:56.083077 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:56.091204 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-912d0cb1-d4be-47e8-b173-1f4911f50cf7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.149807 Jun 16 17:57:56.091770 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 566/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:55 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:57.107421 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:57.108068 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:57.114796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:57.115255 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:57.116027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:57.116500 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:57.249095 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:57.256844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-48ad4376-26c9-4f56-a87e-96436c43e0af tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.153336 Jun 16 17:57:57.257414 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 577/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:57 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:57:58.274460 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:58.275082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:58.282303 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:58.282763 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:58.283548 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:58.283995 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:58.427281 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:58.435316 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-a5be1a83-72de-4ad6-ab6f-468e58178382 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.164785 Jun 16 17:57:58.436639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 567/1144] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:58 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:57:59.454402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:59.454961 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:57:59.457429 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell0:SELECT=2 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:57:59.463222 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:59.463686 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:59.464499 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:59.465013 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:59.841460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:57:59.849796 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-4bdd20fd-e137-4cb1-9020-a35b02d1dfd4 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.399429 Jun 16 17:57:59.859342 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 578/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:57:59 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:00.866474 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:00.867008 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:00.869049 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=2 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:00.869865 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell0:SELECT=6 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:00.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:00.877339 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:00.878122 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:00.878565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:01.009628 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:01.017970 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-0edeb0eb-6b7d-4ab7-b969-956816c07906 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.155510 Jun 16 17:58:01.018536 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 568/1146] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:00 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:58:01.944844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-3c2c6248-1087-4113-9e5e-7f7172c19521 req-b1df3cab-b763-4f8c-b5e2-5ac767b7a95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1573da16-9702-4c0d-a469-9530d24afe03", "name": "network-vif-plugged", "status": "completed", "tag": "37ebbb22-a951-4d8e-a79b-6f226383b18b"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:01.953847 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3c2c6248-1087-4113-9e5e-7f7172c19521 req-b1df3cab-b763-4f8c-b5e2-5ac767b7a95f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:01.954396 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-3c2c6248-1087-4113-9e5e-7f7172c19521 req-b1df3cab-b763-4f8c-b5e2-5ac767b7a95f service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:01.966148 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-3c2c6248-1087-4113-9e5e-7f7172c19521 req-b1df3cab-b763-4f8c-b5e2-5ac767b7a95f service nova] Creating event network-vif-plugged:37ebbb22-a951-4d8e-a79b-6f226383b18b for instance 1573da16-9702-4c0d-a469-9530d24afe03 on hv-cinder-83754 Jun 16 17:58:01.971000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-3c2c6248-1087-4113-9e5e-7f7172c19521 req-b1df3cab-b763-4f8c-b5e2-5ac767b7a95f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029862 Jun 16 17:58:01.971588 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 579/1147] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:58:02.035090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:02.035706 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:02.042095 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:02.042494 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:02.043357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:02.043816 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:02.179200 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:02.186814 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-d1a8d348-9a4d-4404-b402-9a72f47ee0eb tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.155689 Jun 16 17:58:02.187384 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 569/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:02 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:03.204027 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:03.204748 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:03.210894 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:03.211337 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:03.212124 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:03.212589 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:03.341215 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:03.348583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-b33b3c13-40df-46d9-800b-3dd95e031b38 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.149274 Jun 16 17:58:03.349147 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 580/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:03 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:04.365340 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:04.365961 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:04.373024 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:04.373485 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:04.374260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:04.374709 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:04.532548 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:04.540430 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bffae43d-eb4c-49c1-b526-16d592260825 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1265 microversion: 2.1 time: 0.178984 Jun 16 17:58:04.540990 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 570/1150] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:04 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:05.557238 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:05.557859 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:05.565359 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:05.566155 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:05.567515 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:05.568323 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:05.707452 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:05.715052 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-92b39d85-de5a-4b81-bf11-ddeefcb405cc tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1451 microversion: 2.1 time: 0.161750 Jun 16 17:58:05.715614 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 581/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:05 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:05.731412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:05.732051 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:05.738502 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:05.738920 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:05.739684 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:05.740119 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:05.883262 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:05.891996 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-bc93a620-ab3c-4c42-b6ec-9785844e4bb7 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1451 microversion: 2.1 time: 0.164500 Jun 16 17:58:05.892597 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 571/1152] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:05 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:07.479669 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-ca80f6fc-4ae0-45d9-86bc-9b68d0f1c031 req-cc1f59d4-421d-426b-aa25-d94e9aaf9128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1573da16-9702-4c0d-a469-9530d24afe03", "tag": "37ebbb22-a951-4d8e-a79b-6f226383b18b"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:07.489573 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-ca80f6fc-4ae0-45d9-86bc-9b68d0f1c031 req-cc1f59d4-421d-426b-aa25-d94e9aaf9128 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:07.490016 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-ca80f6fc-4ae0-45d9-86bc-9b68d0f1c031 req-cc1f59d4-421d-426b-aa25-d94e9aaf9128 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:07.502569 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-ca80f6fc-4ae0-45d9-86bc-9b68d0f1c031 req-cc1f59d4-421d-426b-aa25-d94e9aaf9128 service nova] Creating event network-changed:37ebbb22-a951-4d8e-a79b-6f226383b18b for instance 1573da16-9702-4c0d-a469-9530d24afe03 on hv-cinder-83754 Jun 16 17:58:07.507572 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-ca80f6fc-4ae0-45d9-86bc-9b68d0f1c031 req-cc1f59d4-421d-426b-aa25-d94e9aaf9128 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Jun 16 17:58:07.508154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 582/1153] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:58:09.156319 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:09.157565 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:09.162031 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-a6653d87-15c4-46f4-9aa1-6e55047cfc14 req-9da72919-efe5-4450-b016-6793ccdf15f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:09.165483 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:09.166193 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:09.167106 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:09.167611 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:09.172001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-a6653d87-15c4-46f4-9aa1-6e55047cfc14 req-9da72919-efe5-4450-b016-6793ccdf15f1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:09.172480 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-a6653d87-15c4-46f4-9aa1-6e55047cfc14 req-9da72919-efe5-4450-b016-6793ccdf15f1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:09.183663 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-a6653d87-15c4-46f4-9aa1-6e55047cfc14 req-9da72919-efe5-4450-b016-6793ccdf15f1 service nova] Creating event network-changed:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:58:09.188985 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-a6653d87-15c4-46f4-9aa1-6e55047cfc14 req-9da72919-efe5-4450-b016-6793ccdf15f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030912 Jun 16 17:58:09.189618 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 583/1154] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:58:09.197490 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Going to try to terminate instance {{(pid=124158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:58:09.285882 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9e345dec-1c20-4129-ab11-b37d59b27f66 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 204 len: 0 microversion: 2.1 time: 0.133542 Jun 16 17:58:09.287054 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 572/1155] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:58:09 2022] DELETE /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:58:09.295972 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:09.296699 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:09.303092 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:09.303538 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:09.304305 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:09.304764 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:09.442507 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:09.450999 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-98da08b9-b362-42f6-b2bd-e39963828375 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.159750 Jun 16 17:58:09.451574 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 584/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:09 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:10.469893 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:10.470651 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:10.479097 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:10.479555 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:10.481043 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:10.481372 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:10.689117 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:10.696723 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-63f0dfc9-875e-467e-9319-eb2365294380 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1570 microversion: 2.1 time: 0.232023 Jun 16 17:58:10.697291 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 573/1157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:10 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:11.715193 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:11.716146 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:11.722726 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:11.723241 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:11.724069 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:11.724682 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:11.822460 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183c052ce8ea4899bf2c07bf63f67fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fb3764f6df42a7835b8458847cad0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:58:11.831081 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-8d9824d7-2101-4d84-a1ac-6a4c58ec10a0 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 200 len: 1383 microversion: 2.1 time: 0.120260 Jun 16 17:58:11.831655 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 585/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:11 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 1383 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:11.873753 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-73167635-e9a3-4045-85bf-327253b07671 req-e90565d5-de74-47de-9e01-d7dffdb97b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2d3671-1fae-4515-8c16-9c99405e7ff1", "name": "network-vif-deleted", "tag": "485bf2ae-6630-43c6-830a-3d331b272b48"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:11.882263 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-73167635-e9a3-4045-85bf-327253b07671 req-e90565d5-de74-47de-9e01-d7dffdb97b17 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:11.882718 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-73167635-e9a3-4045-85bf-327253b07671 req-e90565d5-de74-47de-9e01-d7dffdb97b17 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:11.895111 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-73167635-e9a3-4045-85bf-327253b07671 req-e90565d5-de74-47de-9e01-d7dffdb97b17 service nova] Creating event network-vif-deleted:485bf2ae-6630-43c6-830a-3d331b272b48 for instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 on hv-cinder-83754 Jun 16 17:58:11.900084 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-73167635-e9a3-4045-85bf-327253b07671 req-e90565d5-de74-47de-9e01-d7dffdb97b17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031072 Jun 16 17:58:11.900791 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 574/1159] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:58:12.847962 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:12.848607 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] [instance: 1d2d3671-1fae-4515-8c16-9c99405e7ff1] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:58:12.855223 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:12.855703 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:12.856495 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:58:12.856944 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:58:12.870440 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] HTTP exception thrown: Instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 could not be found. Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Request method failure captured: Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 HTTP/1.1 Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq24nNE7XgclGipvyacuQ0S8lScu5BrFODHfvJ2ogRrjUVdJ0zwDt91vFMmxPgYHftsw-m7FJPiswyw2YQWZ11wnEqeij4av3_3yvJbQPg-yQAMXQcZWw3sZ2Z8xcvjUS1IDBwY8WgJ2uetIcoAQ1zyrzuJLdUu_d30xu6YAJHYexe0M Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 10fb3764f6df42a7835b8458847cad0a Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-TestShelveInstance-1188108266 Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:58:12.872154 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10fb3764f6df42a7835b8458847cad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10fb3764f6df42a7835b8458847cad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10fb3764f6df42a7835b8458847cad0a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10fb3764f6df42a7835b8458847cad0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-TestShelveInstance-1188108266 Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 10fb3764f6df42a7835b8458847cad0a Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-TestShelveInstance-1188108266 Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-TestShelveInstance-1188108266-project Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 183c052ce8ea4899bf2c07bf63f67fd3 Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-TestShelveInstance-1188108266-project Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 could not be found. Jun 16 17:58:12.874017 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '1d2d3671-1fae-4515-8c16-9c99405e7ff1'} Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 could not be found. Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:58:12.875086 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 could not be found. Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 could not be found. Jun 16 17:58:12.876882 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:58:12.878373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Returning 404 to user: Instance 1d2d3671-1fae-4515-8c16-9c99405e7ff1 could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:58:12.878373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-22a5837e-6cd8-4bc1-82b6-d3fe7c2ca906 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1" status: 404 len: 111 microversion: 2.1 time: 0.029620 Jun 16 17:58:12.878373 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 586/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:58:12 2022] GET /compute/v2.1/servers/1d2d3671-1fae-4515-8c16-9c99405e7ff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:58:13.043398 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2d72a17d-2c1a-4864-9cb7-a2de45501b16 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] Calling method '.version_select at 0x7f288cb305e0>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:13.067523 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2d72a17d-2c1a-4864-9cb7-a2de45501b16 tempest-TestShelveInstance-1188108266 tempest-TestShelveInstance-1188108266-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2124786351" status: 202 len: 0 microversion: 2.1 time: 0.029023 Jun 16 17:58:13.068013 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 575/1161] 10.222.0.42 () {58 vars in 1253 bytes} [Thu Jun 16 17:58:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2124786351 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:59:13.874534 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:59:13.875152 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Thu Jun 16 17:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:59:36.592755 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399e3f17-b2ae-41b6-b90f-d2e61014a20f] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 17:59:36.594074 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_api:SELECT=30 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:59:36.594645 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG dbcounter [-] [124157] Writing DB stats nova_cell1:SELECT=62 {{(pid=124157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:59:36.600134 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:36.602001 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83f8fd34-05af-4fb3-a580-2ee6f03d0e4d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 17:59:36.608312 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:36.614333 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-3a6f4e10-b535-4b9c-aa19-23aa8aa26b3d req-9022849d-7200-4d09-bc17-ea2999559f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1573da16-9702-4c0d-a469-9530d24afe03", "tag": "37ebbb22-a951-4d8e-a79b-6f226383b18b"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:36.615502 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:36.616108 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:36.616935 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:36.618000 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:36.618416 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:59:36.619374 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG dbcounter [-] [124158] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:59:36.628101 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-3a6f4e10-b535-4b9c-aa19-23aa8aa26b3d req-9022849d-7200-4d09-bc17-ea2999559f11 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:36.628603 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-3a6f4e10-b535-4b9c-aa19-23aa8aa26b3d req-9022849d-7200-4d09-bc17-ea2999559f11 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:36.643290 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-3a6f4e10-b535-4b9c-aa19-23aa8aa26b3d req-9022849d-7200-4d09-bc17-ea2999559f11 service nova] Creating event network-changed:37ebbb22-a951-4d8e-a79b-6f226383b18b for instance 1573da16-9702-4c0d-a469-9530d24afe03 on hv-cinder-83754 Jun 16 17:59:36.646818 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:59:36.648570 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-3a6f4e10-b535-4b9c-aa19-23aa8aa26b3d req-9022849d-7200-4d09-bc17-ea2999559f11 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051740 Jun 16 17:59:36.649369 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 576/1162] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:36.740514 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-e883e846-d1e9-47d3-9be6-6af8f903a980 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 204 len: 0 microversion: 2.1 time: 0.150574 Jun 16 17:59:36.741661 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 587/1163] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:59:36 2022] DELETE /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:59:36.752667 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:36.753390 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:36.760824 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:36.761283 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:36.762188 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:36.762662 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:37.143766 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:59:37.151497 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-669fcc73-cfc4-4ebe-8ad6-8ca3b62a6740 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1575 microversion: 2.1 time: 0.404495 Jun 16 17:59:37.152079 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 577/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:36 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1575 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:38.169892 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:38.170595 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:38.181816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] [399e3f17-b2ae-41b6-b90f-d2e61014a20f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57670. Jun 16 17:59:38.183844 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:38.184304 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:38.185939 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:38.186385 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:38.685571 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:59:38.693245 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-99903fc0-fc27-4c03-86f3-60b655df2cc5 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1575 microversion: 2.1 time: 0.528066 Jun 16 17:59:38.693813 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 588/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:38 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1575 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:39.393437 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-b71c50e3-6565-4429-a957-a02176a8020b req-32512b5b-5cff-4b2c-b831-d12f4241ff94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1573da16-9702-4c0d-a469-9530d24afe03", "name": "network-vif-deleted", "tag": "37ebbb22-a951-4d8e-a79b-6f226383b18b"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:39.405241 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b71c50e3-6565-4429-a957-a02176a8020b req-32512b5b-5cff-4b2c-b831-d12f4241ff94 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:39.405693 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-b71c50e3-6565-4429-a957-a02176a8020b req-32512b5b-5cff-4b2c-b831-d12f4241ff94 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:39.418629 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-b71c50e3-6565-4429-a957-a02176a8020b req-32512b5b-5cff-4b2c-b831-d12f4241ff94 service nova] Creating event network-vif-deleted:37ebbb22-a951-4d8e-a79b-6f226383b18b for instance 1573da16-9702-4c0d-a469-9530d24afe03 on hv-cinder-83754 Jun 16 17:59:39.424685 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-b71c50e3-6565-4429-a957-a02176a8020b req-32512b5b-5cff-4b2c-b831-d12f4241ff94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036838 Jun 16 17:59:39.425293 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 578/1166] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:39.710993 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:39.712235 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:39.719559 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:39.720233 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:39.721144 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:39.721583 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:39.789903 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:59:39.799597 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-fcf9b8c4-de51-4d6c-9959-9c2b511b16a2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 200 len: 1224 microversion: 2.1 time: 0.092378 Jun 16 17:59:39.801149 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 589/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:39 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:40.814502 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] [83f8fd34-05af-4fb3-a580-2ee6f03d0e4d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57676. Jun 16 17:59:40.818576 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:40.819279 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 1573da16-9702-4c0d-a469-9530d24afe03] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:40.825560 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:40.826025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:40.826794 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:40.827260 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:40.840280 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] HTTP exception thrown: Instance 1573da16-9702-4c0d-a469-9530d24afe03 could not be found. Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Request method failure captured: Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 HTTP/1.1 Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq23BtWow5MW9gk4e-J6QHlvoQNTcCcoZn9YtTRPrcOiRgcbbWOYxoAa8pr0iMQ5Y6LUpc7s8Amf03jmFE28iZt--DBHK0sLMyd6PXB0QtlrUHwjyqiUwKxXo4Q56IbrvyZBl-cQL5MEYpMnbw8HxGLzQQQJ6MvfsOOuEc-UrGM1Oqz4 Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:59:40.842081 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c249c315494483892639b1213d4bc5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c249c315494483892639b1213d4bc5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 31e04db1b0f6444e9a884a0e58ba38da Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 1573da16-9702-4c0d-a469-9530d24afe03 could not be found. Jun 16 17:59:40.843915 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '1573da16-9702-4c0d-a469-9530d24afe03'} Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1573da16-9702-4c0d-a469-9530d24afe03 could not be found. Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:40.844878 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1573da16-9702-4c0d-a469-9530d24afe03 could not be found. Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1573da16-9702-4c0d-a469-9530d24afe03 could not be found. Jun 16 17:59:40.846412 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:40.847810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Returning 404 to user: Instance 1573da16-9702-4c0d-a469-9530d24afe03 could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:40.847810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-08d9ff66-8984-4074-9d0e-a9fff2f27b88 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jun 16 17:59:40.847810 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 579/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:40 2022] GET /compute/v2.1/servers/1573da16-9702-4c0d-a469-9530d24afe03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:59:43.909811 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:43.910312 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:43.912883 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [req-87e09edd-41fe-43b4-a85a-a8f154385c38 req-ffcfaca3-27f1-4fca-9139-f1c922caaf68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16893cb6-ef92-4114-84fb-7cf28b2b85eb", "tag": "2daf38d7-2d75-4fba-bb85-895f29b7ed35"}]} {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:43.917497 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:43.918028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:43.918874 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:43.919402 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:43.921779 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-87e09edd-41fe-43b4-a85a-a8f154385c38 req-ffcfaca3-27f1-4fca-9139-f1c922caaf68 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:43.922223 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [req-87e09edd-41fe-43b4-a85a-a8f154385c38 req-ffcfaca3-27f1-4fca-9139-f1c922caaf68 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:43.933439 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.compute.server_external_events [req-87e09edd-41fe-43b4-a85a-a8f154385c38 req-ffcfaca3-27f1-4fca-9139-f1c922caaf68 service nova] Creating event network-changed:2daf38d7-2d75-4fba-bb85-895f29b7ed35 for instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb on hv-cinder-83754 Jun 16 17:59:43.939411 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [req-87e09edd-41fe-43b4-a85a-a8f154385c38 req-ffcfaca3-27f1-4fca-9139-f1c922caaf68 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030095 Jun 16 17:59:43.940025 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 580/1169] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:43.947243 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Going to try to terminate instance {{(pid=124157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:59:44.031136 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-476409e4-a916-443d-a43d-686bcdf1126b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "DELETE /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 204 len: 0 microversion: 2.1 time: 0.124151 Jun 16 17:59:44.032998 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 590/1170] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:59:43 2022] DELETE /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:59:44.040567 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:44.041610 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:44.048091 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:44.048572 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:44.049357 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:44.049789 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:44.181373 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:59:44.190142 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-72f839d6-5e16-43bc-9754-56b5f5a1e120 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1575 microversion: 2.1 time: 0.153789 Jun 16 17:59:44.190912 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 581/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:44 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:45.207775 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:45.208493 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:45.214828 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:45.215271 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:45.216040 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:45.216489 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:45.351164 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.policy [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:59:45.358967 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-866270a9-703c-4818-9262-9a2935420237 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1575 microversion: 2.1 time: 0.155399 Jun 16 17:59:45.359530 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 591/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:45 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:59:46.376088 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:46.376730 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:46.383495 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:46.383948 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:46.384754 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:46.385197 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:46.614713 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.policy [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e04db1b0f6444e9a884a0e58ba38da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c249c315494483892639b1213d4bc5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:59:46.623094 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-912dd7f0-449a-4c3a-9c36-2d7d6ef7d0b1 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 200 len: 1457 microversion: 2.1 time: 0.251817 Jun 16 17:59:46.624125 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 582/1173] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:46 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 1457 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:46.713186 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [req-7d023130-069e-4401-900f-0295f079a35c req-ddd12f2f-007e-46e0-8fae-a3327bb279b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16893cb6-ef92-4114-84fb-7cf28b2b85eb", "name": "network-vif-deleted", "tag": "2daf38d7-2d75-4fba-bb85-895f29b7ed35"}]} {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:46.724001 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-7d023130-069e-4401-900f-0295f079a35c req-ddd12f2f-007e-46e0-8fae-a3327bb279b1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:46.724457 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [req-7d023130-069e-4401-900f-0295f079a35c req-ddd12f2f-007e-46e0-8fae-a3327bb279b1 service nova] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:46.737523 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.compute.server_external_events [req-7d023130-069e-4401-900f-0295f079a35c req-ddd12f2f-007e-46e0-8fae-a3327bb279b1 service nova] Creating event network-vif-deleted:2daf38d7-2d75-4fba-bb85-895f29b7ed35 for instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb on hv-cinder-83754 Jun 16 17:59:46.742242 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [req-7d023130-069e-4401-900f-0295f079a35c req-ddd12f2f-007e-46e0-8fae-a3327bb279b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Jun 16 17:59:46.742838 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 592/1174] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jun 16 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:47.640862 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:47.642518 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 16893cb6-ef92-4114-84fb-7cf28b2b85eb] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:47.649402 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:47.649864 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:47.650648 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:47.651090 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:47.665191 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] HTTP exception thrown: Instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb could not be found. Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Request method failure captured: Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb HTTP/1.1 Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq23BtWow5MW9gk4e-J6QHlvoQNTcCcoZn9YtTRPrcOiRgcbbWOYxoAa8pr0iMQ5Y6LUpc7s8Amf03jmFE28iZt--DBHK0sLMyd6PXB0QtlrUHwjyqiUwKxXo4Q56IbrvyZBl-cQL5MEYpMnbw8HxGLzQQQJ6MvfsOOuEc-UrGM1Oqz4 Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:59:47.666843 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c249c315494483892639b1213d4bc5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c249c315494483892639b1213d4bc5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 31e04db1b0f6444e9a884a0e58ba38da Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb could not be found. Jun 16 17:59:47.668666 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '16893cb6-ef92-4114-84fb-7cf28b2b85eb'} Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb could not be found. Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:47.669790 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb could not be found. Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb could not be found. Jun 16 17:59:47.671538 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.673354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Returning 404 to user: Instance 16893cb6-ef92-4114-84fb-7cf28b2b85eb could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:47.673354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-9ed53646-bdb7-403b-83d8-a35c13f22f33 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb" status: 404 len: 111 microversion: 2.1 time: 0.032254 Jun 16 17:59:47.673354 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 583/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:47 2022] GET /compute/v2.1/servers/16893cb6-ef92-4114-84fb-7cf28b2b85eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:59:48.118226 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:48.118816 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.compute.api [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:48.126083 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:48.126532 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:48.127324 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:48.127758 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG oslo_concurrency.lockutils [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:48.141371 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.wsgi [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] HTTP exception thrown: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Request method failure captured: Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: request: DELETE /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f HTTP/1.1 Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept: application/json Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Accept-Encoding: identity Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Connection: close Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Length: 0 Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Content-Type: application/json Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Host: 10.222.0.42 Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Openstack-System-Scope: None Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: User-Agent: python-urllib3/1.26.9 Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Auth-Token: gAAAAABiq23BtWow5MW9gk4e-J6QHlvoQNTcCcoZn9YtTRPrcOiRgcbbWOYxoAa8pr0iMQ5Y6LUpc7s8Amf03jmFE28iZt--DBHK0sLMyd6PXB0QtlrUHwjyqiUwKxXo4Q56IbrvyZBl-cQL5MEYpMnbw8HxGLzQQQJ6MvfsOOuEc-UrGM1Oqz4 Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Id: None Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Domain-Name: None Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Identity-Status: Confirmed Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Is-Admin-Project: True Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Id: default Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Domain-Name: Default Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Project-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Role: reader,member Jun 16 17:59:48.142988 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Roles: reader,member Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c249c315494483892639b1213d4bc5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c249c315494483892639b1213d4bc5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-Tenant-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Id: default Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Domain-Name: Default Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Id: 31e04db1b0f6444e9a884a0e58ba38da Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: X-User-Name: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: method: > Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: exception: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.144734 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: action_args: {'id': '955d0309-09c6-4b7b-9238-c3fc7f72480f'} Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:48.145730 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.147369 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.149028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Returning 404 to user: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. {{(pid=124157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:48.149028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-5b32f2fd-370d-4507-ad82-b9a6bfe4bedd tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "DELETE /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 404 len: 111 microversion: 2.1 time: 0.030474 Jun 16 17:59:48.149028 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 593/1176] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jun 16 17:59:48 2022] DELETE /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:59:48.153157 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '>' {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:48.153780 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.compute.api [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] [instance: 955d0309-09c6-4b7b-9238-c3fc7f72480f] Fetching instance by UUID {{(pid=124158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:59:48.160386 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:48.160866 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:48.161639 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:59:48.162082 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG oslo_concurrency.lockutils [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Lock "dc3bf93b-fd76-402a-824a-0db7ba7f07c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:59:48.175940 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.wsgi [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] HTTP exception thrown: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Request method failure captured: Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: request: GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f HTTP/1.1 Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept: application/json Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Accept-Encoding: identity Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Connection: close Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Length: 0 Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Content-Type: application/json Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Host: 10.222.0.42 Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Openstack-System-Scope: None Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: User-Agent: python-urllib3/1.26.9 Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Auth-Token: gAAAAABiq23BtWow5MW9gk4e-J6QHlvoQNTcCcoZn9YtTRPrcOiRgcbbWOYxoAa8pr0iMQ5Y6LUpc7s8Amf03jmFE28iZt--DBHK0sLMyd6PXB0QtlrUHwjyqiUwKxXo4Q56IbrvyZBl-cQL5MEYpMnbw8HxGLzQQQJ6MvfsOOuEc-UrGM1Oqz4 Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Id: None Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Domain-Name: None Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Identity-Status: Confirmed Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Is-Admin-Project: True Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Id: default Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Domain-Name: Default Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Project-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Role: reader,member Jun 16 17:59:48.177484 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Roles: reader,member Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c249c315494483892639b1213d4bc5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c249c315494483892639b1213d4bc5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c249c315494483892639b1213d4bc5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Id: 9c249c315494483892639b1213d4bc5d Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-Tenant-Name: tempest-TestVolumeBootPattern-276852507 Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Id: default Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Domain-Name: Default Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Id: 31e04db1b0f6444e9a884a0e58ba38da Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: X-User-Name: tempest-TestVolumeBootPattern-276852507-project Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: method: > Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: exception: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.179249 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: action_args: {'id': '955d0309-09c6-4b7b-9238-c3fc7f72480f'} Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: {{(pid=124158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:48.180239 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. Jun 16 17:59:48.181880 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: ERROR nova.api.openstack.wsgi Jun 16 17:59:48.183317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: DEBUG nova.api.openstack.wsgi [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Returning 404 to user: Instance 955d0309-09c6-4b7b-9238-c3fc7f72480f could not be found. {{(pid=124158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:48.183317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO nova.api.openstack.requestlog [None req-2861186a-f2e8-4aa3-b81a-66456fb5527b tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f" status: 404 len: 111 microversion: 2.1 time: 0.029652 Jun 16 17:59:48.183317 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: [pid: 124158|app: 0|req: 584/1177] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jun 16 17:59:48 2022] GET /compute/v2.1/servers/955d0309-09c6-4b7b-9238-c3fc7f72480f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:59:49.466317 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: DEBUG nova.api.openstack.wsgi [None req-bb44998e-b240-4922-85fd-479d9da67ac2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] Calling method '.version_select at 0x7f287fe5fe50>' {{(pid=124157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:49.491719 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO nova.api.openstack.requestlog [None req-bb44998e-b240-4922-85fd-479d9da67ac2 tempest-TestVolumeBootPattern-276852507 tempest-TestVolumeBootPattern-276852507-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-988845154" status: 202 len: 0 microversion: 2.1 time: 0.029026 Jun 16 17:59:49.492491 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: [pid: 124157|app: 0|req: 594/1178] 10.222.0.42 () {58 vars in 1259 bytes} [Thu Jun 16 17:59:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-988845154 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:00:50.353117 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:00:50.353742 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Thu Jun 16 18:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:02:21.080776 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:02:21.081423 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Thu Jun 16 18:02:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:02:33.883050 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:02:33.883768 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Thu Jun 16 18:02:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:02:55.271527 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:02:55.272137 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Thu Jun 16 18:02:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:02:57.659907 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:02:57.660552 dv-cinder-837542-4-iscsi devstack@n-api.service[124157]: Thu Jun 16 18:02:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:03:15.672282 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:03:15.672872 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Thu Jun 16 18:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:04:10.361488 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:04:10.362919 dv-cinder-837542-4-iscsi devstack@n-api.service[124158]: Thu Jun 16 18:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!